Letting Users Choose Recommender Algorithms: An Experimental Study

@article{Ekstrand2015LettingUC,
  title={Letting Users Choose Recommender Algorithms: An Experimental Study},
  author={Michael D. Ekstrand and Daniel Kluver and F. Maxwell Harper and Joseph A. Konstan},
  journal={Proceedings of the 9th ACM Conference on Recommender Systems},
  year={2015}
}
Recommender systems are not one-size-fits-all; different algorithms and data sources have different strengths, making them a better or worse fit for different users and use cases. As one way of taking advantage of the relative merits of different algorithms, we gave users the ability to change the algorithm providing their movie recommendations and studied how they make use of this power. We conducted our study with the launch of a new version of the MovieLens movie recommender that supports… 

Figures and Tables from this paper

Rating-Based Collaborative Filtering: Algorithms and Evaluation
TLDR
The concepts, algorithms, and means of evaluation that are at the core of collaborative filtering research and practice are reviewed, and two more recent directions in recommendation algorithms are presented: learning-to-rank and ensemble recommendation algorithms.
User Control in Recommender Systems: Overview and Interaction Challenges
TLDR
This paper reviews and classify the different approaches from the research literature of putting the users into active control of what is recommended, highlights the challenges related to the design of the corresponding user interaction mechanisms and presents the results of a survey-based study.
Generation of Hints to Overcome Difficulty in Operating Interactive Recommender Systems
TLDR
This work focuses on multiattribute utility theory (MAUT) as one of the simplest methods for recommender systems and clarify the difficulties with its usage in interactive environments and proposes an algorithm to generate natural language hints to let users understand ways of operation and see more items that match their preferences.
Interacting with Recommenders—Overview and Research Directions
TLDR
This work provides a comprehensive overview on the existing literature on user interaction aspects in recommender systems, covering existing approaches for preference elicitation and result presentation, as well as proposals that consider recommendation as an interactive process.
Behaviorism is Not Enough: Better Recommendations through Listening to Users
TLDR
It is argued that listening to what users say about the items and recommendations they like, the control they wish to exert on the output, and the ways in which they perceive the system will enable important developments in the future of recommender systems.
Assessing and improving recommender systems to deal with user cold-start problem
TLDR
This thesis proposes 4 approaches to deal with user cold-start problem using existing models available for analysis in the recommender systems and evaluated the proposed approaches in terms of prediction quality and ranking quality in real-world datasets under different recommendation domains.
1 Interacting with Recommenders – Overview and Research Directions
TLDR
This work provides a comprehensive overview on the existing literature on user interaction aspects in recommender systems, covering existing approaches for preference elicitation and result presentation, as well as proposals that consider recommendation as an interactive process.
Does the Users' Tendency to Seek Information Affect Recommender Systems' Performance?
TLDR
A live experiment with real customers coming from a European firm demonstrated that different recommender systems perform differently on several performance metrics and that different users react differently to the same kind of recommendations.
Towards Full End-Users Control of Social Recommendations
TLDR
Preliminary work on the approach for empowering users to generate a recommendation layer above the presentation layer of any existing (even third-party) Web application is presented, concretely, a toolset to support the claims.
...
...

References

SHOWING 1-10 OF 34 REFERENCES
User perception of differences in recommender algorithms
TLDR
It is found that satisfaction is negatively dependent on novelty and positively dependent on diversity in this setting, and that satisfaction predicts the user's final selection of a recommender that they would like to use in the future.
When recommenders fail: predicting recommender failure for algorithm selection and combination
TLDR
This work presents an analysis of the predictions made by several well-known recommender algorithms on the MovieLens 10M data set, showing that for many cases in which one algorithm fails, there is another that will correctly predict the rating.
Item-based collaborative filtering recommendation algorithms
TLDR
This paper analyzes item-based collaborative ltering techniques and suggests that item- based algorithms provide dramatically better performance than user-based algorithms, while at the same time providing better quality than the best available userbased algorithms.
User effort vs. accuracy in rating-based elicitation
TLDR
This study identifies the potentially optimal profile length for an explicit, rating based, and human controlled elicitation strategy and investigates the effects of profile length from both a subjective (user-centric) point of view and an objective (accuracy-based) perspective.
Explaining the user experience of recommender systems
TLDR
This paper proposes a framework that takes a user-centric approach to recommender system evaluation that links objective system aspects to objective user behavior through a series of perceptual and evaluative constructs (called subjective system aspects and experience, respectively).
Hybrid Recommender Systems: Survey and Experiments
  • R. Burke
  • Computer Science
    User Modeling and User-Adapted Interaction
  • 2004
TLDR
This paper surveys the landscape of actual and possible hybrid recommenders, and introduces a novel hybrid, EntreeC, a system that combines knowledge-based recommendation and collaborative filtering to recommend restaurants, and shows that semantic ratings obtained from the knowledge- based part of the system enhance the effectiveness of collaborative filtering.
Exploring the filter bubble: the effect of using recommender systems on content diversity
TLDR
This paper examines the longitudinal impacts of a collaborative filtering-based recommender system on users and contributes a novel metric to measure content diversity based on information encoded in user-generated tags, and presents a new set of methods to examine the temporal effect of recommender systems on the user experience.
Don't look stupid: avoiding pitfalls when recommending research papers
TLDR
This work performs a detailed user study with over 130 users to understand differences between recommender algorithms through an online survey of paper recommendations from the ACM Digital Library, and succinctly summarizes the most striking results as "Don't Look Stupid" in front of users.
User-centric evaluation of a K-furthest neighbor collaborative filtering recommender algorithm
TLDR
This paper presents an inverted neighborhood model, k-Furthest Neighbors, to identify less ordinary neighborhoods for the purpose of creating more diverse recommendations and shows that even though the proposed furthest neighbor model is outperformed in the traditional evaluation setting, the perceived usefulness of the algorithm shows no significant difference in the results of the user study.
Dynamic generation of personalized hybrid recommender systems
TLDR
This work focuses on dynamically building personalized hybrid recommender systems on an individual user basis by means of a dynamic online learning strategy that combines the most appropriate recommendation algorithms for a user based on realtime relevance feedback.
...
...