Letting Users Choose Recommender Algorithms: An Experimental Study

@article{Ekstrand2015LettingUC,
  title={Letting Users Choose Recommender Algorithms: An Experimental Study},
  author={Michael D. Ekstrand and Daniel Kluver and F. Maxwell Harper and Joseph A. Konstan},
  journal={Proceedings of the 9th ACM Conference on Recommender Systems},
  year={2015}
}
Recommender systems are not one-size-fits-all; different algorithms and data sources have different strengths, making them a better or worse fit for different users and use cases. As one way of taking advantage of the relative merits of different algorithms, we gave users the ability to change the algorithm providing their movie recommendations and studied how they make use of this power. We conducted our study with the launch of a new version of the MovieLens movie recommender that supports… 
View on ACM
md.ekstrandom.net
89 Citations
Highly Influential Citations
2
Background Citations
31
Methods Citations
7
Results Citations
1

Figures and Tables from this paper

89 Citations

Rating-Based Collaborative Filtering: Algorithms and Evaluation

The concepts, algorithms, and means of evaluation that are at the core of collaborative filtering research and practice are reviewed, and two more recent directions in recommendation algorithms are presented: learning-to-rank and ensemble recommendation algorithms.

User Control in Recommender Systems: Overview and Interaction Challenges

This paper reviews and classify the different approaches from the research literature of putting the users into active control of what is recommended, highlights the challenges related to the design of the corresponding user interaction mechanisms and presents the results of a survey-based study.

Long-term effects of user preference-oriented recommendation method on the evolution of online system

Interacting with Recommenders—Overview and Research Directions

This work provides a comprehensive overview on the existing literature on user interaction aspects in recommender systems, covering existing approaches for preference elicitation and result presentation, as well as proposals that consider recommendation as an interactive process.

Assessing and improving recommender systems to deal with user cold-start problem

This thesis proposes 4 approaches to deal with user cold-start problem using existing models available for analysis in the recommender systems and evaluated the proposed approaches in terms of prediction quality and ranking quality in real-world datasets under different recommendation domains.

Does the Users' Tendency to Seek Information Affect Recommender Systems' Performance?

A live experiment with real customers coming from a European firm demonstrated that different recommender systems perform differently on several performance metrics and that different users react differently to the same kind of recommendations.

Exploring Multi-List User Interfaces for Similar-Item Recommendations

Investigations showed that decision-making is slower and more demanding with multi-list interfaces, but that users also explore more options before making a decision, and the importance of considering social-based similarity measures.

A Novel, Serendipitous and Dynamic User-Centric Recommender Algorithm

This paper used web content mining to gather user profiles from social media, model these profiles, and create an algorithm to suggest user preferences, which testify that many users’ social profiles for Zimbabweans dominate quite well to determine user preferences.

A Bayesian User-Controllable Recommender System

This research proposes a Bayesian User-Controllable Recommender System that allows the user to control the contextual information, i.e., the user can define the content and parameters used by the recommender to compute predictions.

Paper Survey And Example Of Collaborative Filtering Implementation In Recommender System

By comparing with restaurant samples, adequate measures to evaluate the recommender system quality in user profiling are described, showing that Latent Semantic Analysis (LSA) method has a better chance to solveRecommender system issues especially in web search and user profiling.
...

References

SHOWING 1-10 OF 30 REFERENCES

User perception of differences in recommender algorithms

It is found that satisfaction is negatively dependent on novelty and positively dependent on diversity in this setting, and that satisfaction predicts the user's final selection of a recommender that they would like to use in the future.

When recommenders fail: predicting recommender failure for algorithm selection and combination

This work presents an analysis of the predictions made by several well-known recommender algorithms on the MovieLens 10M data set, showing that for many cases in which one algorithm fails, there is another that will correctly predict the rating.

Item-based collaborative filtering recommendation algorithms

This paper analyzes item-based collaborative ltering techniques and suggests that item- based algorithms provide dramatically better performance than user-based algorithms, while at the same time providing better quality than the best available userbased algorithms.

User effort vs. accuracy in rating-based elicitation

This study identifies the potentially optimal profile length for an explicit, rating based, and human controlled elicitation strategy and investigates the effects of profile length from both a subjective (user-centric) point of view and an objective (accuracy-based) perspective.

Hybrid Recommender Systems: Survey and Experiments

  • R. Burke
  • Computer Science
    User Modeling and User-Adapted Interaction
  • 2004
This paper surveys the landscape of actual and possible hybrid recommenders, and introduces a novel hybrid, EntreeC, a system that combines knowledge-based recommendation and collaborative filtering to recommend restaurants, and shows that semantic ratings obtained from the knowledge- based part of the system enhance the effectiveness of collaborative filtering.

Exploring the filter bubble: the effect of using recommender systems on content diversity

This paper examines the longitudinal impacts of a collaborative filtering-based recommender system on users and contributes a novel metric to measure content diversity based on information encoded in user-generated tags, and presents a new set of methods to examine the temporal effect of recommender systems on the user experience.

Don't look stupid: avoiding pitfalls when recommending research papers

This work performs a detailed user study with over 130 users to understand differences between recommender algorithms through an online survey of paper recommendations from the ACM Digital Library, and succinctly summarizes the most striking results as "Don't Look Stupid" in front of users.

User-centric evaluation of a K-furthest neighbor collaborative filtering recommender algorithm

This paper presents an inverted neighborhood model, k-Furthest Neighbors, to identify less ordinary neighborhoods for the purpose of creating more diverse recommendations and shows that even though the proposed furthest neighbor model is outperformed in the traditional evaluation setting, the perceived usefulness of the algorithm shows no significant difference in the results of the user study.

Dynamic generation of personalized hybrid recommender systems

This work focuses on dynamically building personalized hybrid recommender systems on an individual user basis by means of a dynamic online learning strategy that combines the most appropriate recommendation algorithms for a user based on realtime relevance feedback.

Fab: content-based, collaborative recommendation

It is explained how a hybrid system can incorporate the advantages of both methods while inheriting the disadvantages of neither, and how the particular design of the Fab architecture brings two additional benefits.