Optimal control of a single queue with retransmissions: delay-dropping tradeoffs

  title={Optimal control of a single queue with retransmissions: delay-dropping tradeoffs},
  author={Anastasios Giovanidis and Gerhard Wunder and J{\"o}rg B{\"u}hler},
  journal={IEEE Transactions on Wireless Communications},
A single queue incorporating a retransmission protocol is investigated, assuming that the sequence of per effort success probabilities in the Automatic Retransmission reQuest (ARQ) chain is a priori defined and no channel state information at the transmitter is available. A Markov Decision Problem with an average cost criterion is formulated where the possible actions are to either continue the retransmission process of an erroneous packet at the next time slot or to drop the packet and move on… 

Figures and Tables from this paper

An Overview for Markov Decision Processes in Queues and Networks
This paper provides a detailed overview on MDPs in queues and networks and tracks the evolution of many basic results and summarizes several interesting directions in the future research.
Scheduling Strategy for Multimedia Heterogeneous High-Speed Train Networks
The martingale theory is utilized to obtain the theoretic value of the end-to-end delay bounds under two kinds of scheduling mechanisms: first in first out (FIFO) and earliest deadline first (EDF) and the working principle of the hybrid scheduling strategy is verified.
Real-Time Remote Estimation With Hybrid ARQ in Wireless Networked Control
This paper proposes a hybrid automatic repeat request (HARQ)-based real-time remote estimation framework for linear time-invariant (LTI) dynamic systems, and derives a sufficient condition of the existence of a stationary and deterministic optimal policy that stabilizes the remote estimation system and minimizes the MSE.
Grid Energy Consumption and QoS Tradeoff in Hybrid Energy Supply Wireless Networks
The total service cost is introduced as the performance metric, which is the weighted sum of the grid energy cost and the QoS degradation cost, and a Greedy Assignment algorithm with low complexity and near-optimal performance is proposed.
A novel adaptive code block group hybrid automatic repeat request scheme for low earth orbit satellite networks
This paper proposes an optimal HARQ scheme for LEO satellite networks with the Markov decision process (MDP) based on the fuzzy Q‐learning (FQL) algorithm to improve the accuracy of ACBG‐HARQ state transfer, which contributes to adaptive selection of the HARQ code block group size.


An Optimal Stopping Approach to ARQ Protocols with Variable Success Probabilities per Retransmission
In the current work the conceptual framework of optimally stopping a stochastic process is used to determine the optimal maximum number of retransmissions in an ARQ chain. The process sequentially
Optimal power allocation policies for the reliable transmission of a single packet via ARQ protocols
We derive the optimal power allocation policy for the transmission of a single packet of information via stop-and-wait ARQ (automatic retransmission request). Using finite-horizon Markov decision
Wireless scheduling with hybrid ARQ
This work transforms a model for downlink wireless scheduling into a different model that fits into a framework for stochastic scheduling developed by Klimov, and shows that the optimal schedulers for the transformed models in both scenarios are specified by fixed priority rules.
Joint Rate and Power Adaptation for Type-I Hybrid ARQ Systems Over Correlated Fading Channels Under Different Buffer-Cost Constraints
A general framework for the computation of the optimal scheduling policies for delay and overflow-constrained joint rate and power adaptations for type-I hybrid automatic-repeat-request systems for bursty nonconstant packet arrivals is presented.
Optimal control of a queueing system with two heterogeneous servers
It is shown that the optimal policy which minimizes the mean sojourn time of customers in the system is of threshold type.
Optimal Power and Rate Control for Minimal Average Delay: The Single-User Case
This paper analyzes a single-user communication system composed of a transmitter preceded by a queue used for retransmissions, Gaussian block-fading channel, and a receiver, and the system average delay is optimized by using combined power/rate control under average power constraints.
Transmission schemes for time-varying wireless channels with partial state observations
  • Danlu Zhang, K. Wasserman
  • Computer Science
    Proceedings.Twenty-First Annual Joint Conference of the IEEE Computer and Communications Societies
  • 2002
A control algorithm or transmission scheme that determines when to attempt a transmission and at what power level is developed, so as to achieve a suitable balance between throughput and energy consumption; and the effect of channel memory on the performance, design, and structure of this scheme is studied.
Optimizing the ARQ performance in downlink packet data systems with scheduling
A systematic approach to optimize the mapping between signal-to-interference-and-noise ratio (SINR) and modulation and coding scheme (MCS) to maximize the throughput by taking into account the type of HARQ scheme employed.
The throughput of hybrid-ARQ protocols for the Gaussian collision channel
The throughput of automatic retransmission request (ARQ) protocols is compared to that of code division multiple access (CDMA) with conventional decoding and Interestingly, the ARQ systems are not interference-limited even if no multiuser detection or joint decoding is used, as opposed to conventional CDMA.
Delay-aware Power Adaptation for Incremental Redundancy Hybrid ARQ over Fading Channels with Memory
It is shown that the optimal power adaptation law under buffer delay and packet overflow constraints can be obtained using the framework of semi-Markov decision processes.