From Ads to Interventions: Contextual Bandits in Mobile Health

@inproceedings{Tewari2017FromAT,
  title={From Ads to Interventions: Contextual Bandits in Mobile Health},
  author={Ambuj Tewari and Susan A. Murphy},
  booktitle={Mobile Health - Sensors, Analytic Methods, and Applications},
  year={2017}
}
The first paper on contextual bandits was written by Michael Woodroofe in 1979 [1] but the term “contextual bandits” was invented only recently in 2008 by Langford and Zhang [2]. Woodroofe’s motivating application was clinical trials whereas modern interest in this problem was driven to a great extent by problems on the internet, such as online ad and online news article placement. We have now come full circle because contextual bandits provide a natural framework for sequential decision making… CONTINUE READING