Design of AoI-Aware 5G Uplink Scheduler Using Reinforcement Learning

  title={Design of AoI-Aware 5G Uplink Scheduler Using Reinforcement Learning},
  author={Chien-Cheng Wu and Petar Popovski and Z. Tan and {\vC}edomir Stefanovi{\'c}},
  journal={2021 IEEE 4th 5G World Forum (5GWF)},
Age of Information (AoI) reflects the time that is elapsed from the generation of a packet by a 5G user equipment (UE) to the reception of the packet by a controller. A design of an AoI-aware radio resource scheduler for UEs via reinforcement learning is proposed in this paper. In this paper, we consider a remote control environment in which a number of UEs are transmitting time-sensitive measurements to a remote controller. We consider the AoI minimization problem and formulate the problem as… 

Figures and Tables from this paper


Age Minimization of Multiple Flows using Reinforcement Learning
The goal of this paper is to apply reinforcement learning methods to achieve scheduling decisions that are resilient to network conditions and packet arrival processes, and Policy Gradients and Deep Q-Learning methods are employed.
A Reinforcement Learning Approach to Age of Information in Multi-User Networks
Scheduling the transmission of time-sensitive data to multiple users over error-prone communication channels is studied with the goal of minimizing the longterm average age of information (AoI) at
Optimizing Age of Information in Wireless Networks with Throughput Constraints
This paper develops three low-complexity transmission scheduling policies that attempt to minimize AoI subject to minimum throughput requirements and evaluates their performance against the optimal policy, and develops a randomized policy, a Max-Weight policy and a Whittle's Index policy.
Learning Optimal Resource Allocations in Wireless Systems
DNNs are trained here with a model-free primal-dual method that simultaneously learns a DNN parameterization of the resource allocation policy and optimizes the primal and dual variables.
Scheduling Policies for Minimizing Age of Information in Broadcast Wireless Networks
This is the first work to derive performance guarantees for scheduling policies that attempt to minimize AoI in wireless networks with unreliable channels and shows that both the Max-Weight and Whittle’s Index policies outperform the other scheduling policies in every configuration simulated, and achieve near optimal performance.
Optimal Link Scheduling for Age Minimization in Wireless Systems
This work investigates age minimization in a wireless network and proposes a novel approach of optimizing the scheduling strategy to deliver all messages as fresh as possible and proves it is NP-hard in general.
Age of information: Design and analysis of optimal scheduling algorithms
This paper forms a Markov decision process (MDP) to find dynamic transmission scheduling schemes, with the purpose of minimizing the long-run average age, and proposes both optimal off-line and online scheduling algorithms for the finite-approximate MDPs, depending on knowledge of time-varying arrivals.
Average Peak Age-of-Information Minimization in UAV-Assisted IoT Networks
The role of an unmanned aerial vehicle (UAV) as a mobile relay to minimize the average peak age-of-information for a source–destination pair and an efficient iterative algorithm is proposed to solve this non-convex problem.
Ultra-Reliable Low-Latency Vehicular Networks: Taming the Age of Information Tail
The problem of vehicles' power minimization while ensuring stringent latency and reliability constraints in terms of probabilistic AoI is studied and a novel and efficient mapping between both AoI and queue length distributions is proposed.
Minimizing age of information in vehicular networks
  • S. Kaul, M. Gruteser, V. Rai, J. Kenney
  • Computer Science
    2011 8th Annual IEEE Communications Society Conference on Sensor, Mesh and Ad Hoc Communications and Networks
  • 2011
This work proposes a more comprehensive metric, the average system information age, which captures the requirement of emerging applications to maintain current state information from all other nearby nodes, and designs an application-layer broadcast rate adaptation algorithm that effectively adapts the messaging rates and minimizes the system age.