Markov Decision Processes With Applications in Wireless Sensor Networks: A Survey

  title={Markov Decision Processes With Applications in Wireless Sensor Networks: A Survey},
  author={Mohammad Abu Alsheikh and Dinh Thai Hoang and Dusit Niyato and Hwee Pink Tan and Shaowei Lin},
  journal={IEEE Communications Surveys & Tutorials},
Wireless sensor networks (WSNs) consist of autonomous and resource-limited devices. The devices cooperate to monitor one or more physical phenomena within an area of interest. WSNs operate as stochastic systems because of randomness in the monitored environments. For long service time and low maintenance cost, WSNs require adaptive and robust methods to address data exchange, topology formulation, resource and power optimization, sensing coverage and object detection, and security challenges… CONTINUE READING
Highly Cited
This paper has 106 citations. REVIEW CITATIONS
Related Discussions
This paper has been referenced on Twitter 1 time. VIEW TWEETS


Publications citing this paper.
Showing 1-10 of 43 extracted citations

MDP-Based Model for Interest Scheduling in IoT-NDN Environment

IEEE Communications Letters • 2018
View 3 Excerpts
Highly Influenced

106 Citations

Citations per Year
Semantic Scholar estimates that this publication has 106 citations based on the available data.

See our FAQ for additional information.


Publications referenced by this paper.
Showing 1-10 of 167 references

Optimal mode selection for cognitive radio sensor networks with RF energy harvesting

2012 IEEE 23rd International Symposium on Personal, Indoor and Mobile Radio Communications - (PIMRC) • 2012
View 7 Excerpts
Highly Influenced

Relay Scheduling for Cooperative Communications in Sensor Networks with Energy Harvesting

IEEE Transactions on Wireless Communications • 2011
View 5 Excerpts
Highly Influenced

Partially Observable Markov Decision Process for Transmitter Power Control in Wireless Sensor Networks

2008 Bio-inspired, Learning and Intelligent Systems for Security • 2008
View 5 Excerpts
Highly Influenced

Using Incompletely Cooperative Game Theory in Wireless Sensor Networks

2008 IEEE Wireless Communications and Networking Conference • 2008
View 19 Excerpts
Highly Influenced

Energy Efficient Multiple Target Tracking in Wireless Sensor Networks

IEEE Transactions on Vehicular Technology • 2007
View 5 Excerpts
Highly Influenced

Near-optimal reinforcement learning framework for energy-aware sensor communications

IEEE Journal on Selected Areas in Communications • 2005
View 5 Excerpts
Highly Influenced

Similar Papers

Loading similar papers…