• Corpus ID: 234771672

Cache Replacement as a MAB with Delayed Feedback and Decaying Costs

@inproceedings{Yusuf2020CacheRA,
  title={Cache Replacement as a MAB with Delayed Feedback and Decaying Costs},
  author={Farzana Beente Yusuf and Vitalii Stebliankin and Giuseppe Vietri and Giri Narasimhan},
  year={2020}
}
Inspired by the cache replacement problem, we propose and solve a new variant of the well-known multi-armed bandit (MAB), thus providing a solution for improving existing state-of-the-art cache management methods. Each arm (or expert) represents a distinct cache replacement policy, which advises on the page to evict from the cache when needed. Feedback on the eviction comes in the form of a “miss”, but at an indeterminate time after the action is taken, and the cost of the eviction is set to be… 

Figures from this paper