Benchmarking News Recommendations: The CLEF NewsREEL Use Case

  title={Benchmarking News Recommendations: The CLEF NewsREEL Use Case},
  author={F. Hopfgartner and Torben Brodt and J. Seiler and Benjamin Kille and A. Lommatzsch and M. Larson and R. Turrin and Andr{\'a}s Ser{\'e}ny},
  journal={SIGIR Forum},
The CLEF NewsREEL challenge is a campaign-style evaluation lab allowing participants to evaluate and optimize news recommender algorithms. The goal is to create an algorithm that is able to generate news items that users would click, respecting a strict time constraint. The lab challenges participants to compete in either a "living lab" (Task 1) or perform an evaluation that replays recorded streams (Task 2). In this report, we discuss the objectives and challenges of the NewsREEL lab… Expand
41 Citations

Figures and Topics from this paper

CLEF NewsREEL 2016: Comparing Multi-dimensional Offline and Online Evaluation of News Recommender Systems
  • 4
  • PDF
News Recommender System based on Association Rules @ CLEF NewsREEL 2017
  • 2
  • PDF
CLEF NewsREEL 2017: Contextual Bandit News Recommendation
  • 1
  • PDF
Overview of NewsREEL'16: Multi-dimensional Evaluation of Real-Time Stream-Recommendation Algorithms
  • 21
  • PDF
RARE : A Recurrent Attentive Recommendation Engine for News Aggregators
  • PDF
Streamingrec: a framework for benchmarking stream-based news recommenders
  • 22
  • PDF


CLEF 15th Birthday
  • 16
  • Highly Influential
  • PDF