• Corpus ID: 8770532

Smart Exploration in HetNets : Minimizing Total Regret with mmWave

  title={Smart Exploration in HetNets : Minimizing Total Regret with mmWave},
  author={Michael Wang and Aveek Dutta and Swapna Buccapatnam and Mung Chiang},
We model and analyze a User-Equipment (UE) based wireless network selection method where individuals act on their stochastic knowledge of the expected behavior off their available networks. In particular, we focus on networks with millimeter-wave (mmWave) radio. Modeling mmWave radio access technologies (RATs) as a stochastic 3-state process based on their physical layer characteristics in Line-of-Sight (LOS), NonLine-of-Sight (NLOS), and Outage states, we make the realistic assumption that… 

Figures and Tables from this paper

Message Passing Based Distributed Learning for Joint Resource Allocation in Millimeter Wave Heterogeneous Networks

This paper studies the joint power control and user association problem in heterogeneous networks (HetNets) by considering the dynamics of links as a Markov Decision Process (MDP), and a reinforcement learning framework is proposed to study the problem.

Reinforcement Learning Based Handoff for Millimeter Wave Heterogeneous Cellular Networks

A reinforcement learning based handoff policy named LESH is proposed to reduce the number of handoffs while maintaining user Quality of Service (QoS) requirements in mmWave HetNets and proposes reinforcement-learning based BS selection algorithms for different UE densities.

Delay-Optimal Scheduling for Integrated mmWave Sub-6 GHz Systems with Markovian Blockage Model

This paper provides an integrated mmWavesub-6 GHz architecture to combat blockage and intermittent connectivity of the mmWave communications, and proposes a certainty-equivalence threshold-based learning algorithm, and provides an upper bound on its regret.

Joint Millimeter Wave and Microwave Resources Allocation in Cellular Networks With Dual-Mode Base Stations

Simulation results show that the proposed approach significantly increases the number of satisfied UAs while improving the statistics of QoS violations and enhancing the overall users’ quality-of-experience.

On the Intersection of Communication and Machine Learning

This thesis introduced an reinforcement learning framework to solve the resource allocation problems in heterogeneous millimeter wave network and proposed the distributed coreset based boosting framework.

Safeguard Network Slicing in 5G: A Learning Augmented Optimization Approach

A learning augmented optimization approach with deep learning and Lyapunov stability theories enables the system to learn a safe slicing solution from both historical records and run-time observations, and proves that the proposed solution is always feasible and nearly optimal, up to a constant additive factor.

The SMART Handoff Policy for Millimeter Wave Heterogeneous Cellular Networks

A reinforcement learning based handoff policy named SMART is proposed to reduce the number of handoffs while maintaining user Quality of Service (QoS) requirements in mmWave HetNets and proposes reinforcement-learning based BS selection algorithms for different UE densities.



An MDP model for optimal handover decisions in mmWave cellular networks

This paper proposes a Markov Decision Process (MDP) framework to study the properties and performance of the proposed cell selection strategy, and uses the Value Iteration Algorithm (VIA) to solve the MDP, and obtains the optimal set of associations.

RAT selection games in HetNets

The dynamics of network selection in heterogeneous wireless networks (HetNets) is studied, and it is shown that RAT selection games converge to Nash equilibria in a small number of steps, and hence are amenable to practical implementation.

User Association for Load Balancing in Heterogeneous Cellular Networks

A low-complexity distributed algorithm that converges to a near-optimal solution with a theoretical performance guarantee is provided, and it is observed that simple per-tier biasing loses surprisingly little, if the bias values Aj are chosen carefully.

Fair and Efficient User-Network Association Algorithm for Multi-Technology Wireless Networks

This paper designs a fully distributed algorithm based on trial and error mechanisms that exploits the benefits of vertical handover by finding fair and efficient assignment schemes and analytically shows the convergence of the algorithm toFair and efficient solutions.

Millimeter Wave Channel Modeling and Cellular Capacity Evaluation

Detailed spatial statistical models of the channels are derived and it is found that, even in highly non-line-of-sight environments, strong signals can be detected 100-200 m from potential cell sites, potentially with multiple clusters to support spatial multiplexing.

Millimeter-Wave Cellular Wireless Networks: Potentials and Challenges

Measurements and capacity studies are surveyed to assess mmW technology with a focus on small cell deployments in urban environments and it is shown that mmW systems can offer more than an order of magnitude increase in capacity over current state-of-the-art 4G cellular networks at current cell densities.

Broadband Millimeter-Wave Propagation Measurements and Models Using Adaptive-Beam Antennas for Outdoor Urban Cellular Communications

Measurements and models that may be used to design future fifth-generation millimeter-wave cellular networks are provided and insight into antenna beam steering algorithms for these systems are given.

MOTA: engineering an operator agnostic mobile service

This work proposes concise network signalling that assists users to make informed choices even under mobility, and develops user-choice algorithms that maximize a suitable notion of user satisfaction while using spectrum resources efficiently.

Wideband mmWave channels: Implications for design and implementation of adaptive beam antennas

Millimeter wave mobile systems equipped with adaptive antennas show tremendous potential to provide much higher data rates than traditional cellular systems while offering comparable signal quality.

Online algorithms for the multi-armed bandit problem with Markovian rewards

  • Cem TekinM. Liu
  • Computer Science
    2010 48th Annual Allerton Conference on Communication, Control, and Computing (Allerton)
  • 2010
It is shown that under certain conditions on the state transition probabilities of the arms, a sample mean based index policy achieves logarithmic regret uniformly over the total number of trials.