Corpus ID: 8770532

Smart Exploration in HetNets : Minimizing Total Regret with mmWave

@inproceedings{Wang2016SmartEI,
  title={Smart Exploration in HetNets : Minimizing Total Regret with mmWave},
  author={Michael Wang and Aveek Dutta and Swapna Buccapatnam and Mung Chiang},
  year={2016}
}
We model and analyze a User-Equipment (UE) based wireless network selection method where individuals act on their stochastic knowledge of the expected behavior off their available networks. In particular, we focus on networks with millimeter-wave (mmWave) radio. Modeling mmWave radio access technologies (RATs) as a stochastic 3-state process based on their physical layer characteristics in Line-of-Sight (LOS), NonLine-of-Sight (NLOS), and Outage states, we make the realistic assumption that… Expand

Figures and Tables from this paper

Message Passing Based Distributed Learning for Joint Resource Allocation in Millimeter Wave Heterogeneous Networks
TLDR
This paper studies the joint power control and user association problem in heterogeneous networks (HetNets) by considering the dynamics of links as a Markov Decision Process (MDP), and a reinforcement learning framework is proposed to study the problem. Expand
The SMART Handoff Policy for Millimeter Wave Heterogeneous Cellular Networks
TLDR
A reinforcement learning based handoff policy named SMART is proposed to reduce the number of handoffs while maintaining user Quality of Service (QoS) requirements in mmWave HetNets and proposes reinforcement-learning based BS selection algorithms for different UE densities. Expand
Reinforcement Learning Based Handoff for Millimeter Wave Heterogeneous Cellular Networks
TLDR
A reinforcement learning based handoff policy named LESH is proposed to reduce the number of handoffs while maintaining user Quality of Service (QoS) requirements in mmWave HetNets and proposes reinforcement-learning based BS selection algorithms for different UE densities. Expand
Joint Millimeter Wave and Microwave Resources Allocation in Cellular Networks With Dual-Mode Base Stations
TLDR
Simulation results show that the proposed approach significantly increases the number of satisfied UAs while improving the statistics of QoS violations and enhancing the overall users’ quality-of-experience. Expand
On the Intersection of Communication and Machine Learning
TLDR
This thesis introduced an reinforcement learning framework to solve the resource allocation problems in heterogeneous millimeter wave network and proposed the distributed coreset based boosting framework. Expand
Safeguard Network Slicing in 5G: A Learning Augmented Optimization Approach
TLDR
A learning augmented optimization approach with deep learning and Lyapunov stability theories enables the system to learn a safe slicing solution from both historical records and run-time observations, and proves that the proposed solution is always feasible and nearly optimal, up to a constant additive factor. Expand

References

SHOWING 1-10 OF 20 REFERENCES
An MDP model for optimal handover decisions in mmWave cellular networks
TLDR
This paper proposes a Markov Decision Process (MDP) framework to study the properties and performance of the proposed cell selection strategy, and uses the Value Iteration Algorithm (VIA) to solve the MDP, and obtains the optimal set of associations. Expand
RAT selection games in HetNets
TLDR
The dynamics of network selection in heterogeneous wireless networks (HetNets) is studied, and it is shown that RAT selection games converge to Nash equilibria in a small number of steps, and hence are amenable to practical implementation. Expand
User Association for Load Balancing in Heterogeneous Cellular Networks
TLDR
A low-complexity distributed algorithm that converges to a near-optimal solution with a theoretical performance guarantee is provided, and it is observed that simple per-tier biasing loses surprisingly little, if the bias values Aj are chosen carefully. Expand
Fair and Efficient User-Network Association Algorithm for Multi-Technology Wireless Networks
TLDR
This paper designs a fully distributed algorithm based on trial and error mechanisms that exploits the benefits of vertical handover by finding fair and efficient assignment schemes and analytically shows the convergence of the algorithm toFair and efficient solutions. Expand
Millimeter Wave Channel Modeling and Cellular Capacity Evaluation
TLDR
Detailed spatial statistical models of the channels are derived and it is found that, even in highly non-line-of-sight environments, strong signals can be detected 100-200 m from potential cell sites, potentially with multiple clusters to support spatial multiplexing. Expand
Millimeter-Wave Cellular Wireless Networks: Potentials and Challenges
TLDR
Measurements and capacity studies are surveyed to assess mmW technology with a focus on small cell deployments in urban environments and it is shown that mmW systems can offer more than an order of magnitude increase in capacity over current state-of-the-art 4G cellular networks at current cell densities. Expand
Broadband Millimeter-Wave Propagation Measurements and Models Using Adaptive-Beam Antennas for Outdoor Urban Cellular Communications
TLDR
Measurements and models that may be used to design future fifth-generation millimeter-wave cellular networks are provided and insight into antenna beam steering algorithms for these systems are given. Expand
MOTA: engineering an operator agnostic mobile service
TLDR
This work proposes concise network signalling that assists users to make informed choices even under mobility, and develops user-choice algorithms that maximize a suitable notion of user satisfaction while using spectrum resources efficiently. Expand
Wideband mmWave channels: Implications for design and implementation of adaptive beam antennas
  • Shu Sun, T. Rappaport
  • Engineering
  • 2014 IEEE MTT-S International Microwave Symposium (IMS2014)
  • 2014
Millimeter wave mobile systems equipped with adaptive antennas show tremendous potential to provide much higher data rates than traditional cellular systems while offering comparable signal quality.Expand
Online algorithms for the multi-armed bandit problem with Markovian rewards
  • Cem Tekin, M. Liu
  • Computer Science, Mathematics
  • 2010 48th Annual Allerton Conference on Communication, Control, and Computing (Allerton)
  • 2010
TLDR
It is shown that under certain conditions on the state transition probabilities of the arms, a sample mean based index policy achieves logarithmic regret uniformly over the total number of trials. Expand
...
1
2
...