Conducting user experiments in recommender systems

@inproceedings{Knijnenburg2012ConductingUE,
  title={Conducting user experiments in recommender systems},
  author={Bart P. Knijnenburg},
  booktitle={RecSys '12},
  year={2012}
}
There is an increasing consensus in the field of recommender systems that we should move beyond the offline evaluation of algorithms towards a more user-centric approach. This tutorial teaches the essential skills involved in conducting user experiments, the scientific approach to user-centric evaluation. Such experiments are essential in uncovering how and why the user experience of recommender systems comes about. 
Evaluating Recommender Systems for Technology Enhanced Learning: A Quantitative Survey
Recommender Systems in Industry: A Netflix Case Study
Mixed methods for evaluating user satisfaction
Evaluating Intelligent User Interfaces with User Experiments
...
1
2
...

References

Context-Aware Recommender Systems Recommender Systems Handbook
  • Context-Aware Recommender Systems Recommender Systems Handbook
  • 2011