• Corpus ID: 42914272

The Demographics of Cool: Popularity and Recommender Performance for Different Groups of Users

@inproceedings{Ekstrand2017TheDO,
  title={The Demographics of Cool: Popularity and Recommender Performance for Different Groups of Users},
  author={Michael D. Ekstrand and Maria Soledad Pera},
  booktitle={RecSys Posters},
  year={2017}
}
ABSTRACT Typical recommender evaluations treat users as an homogeneous unit. However, user subgroups often differ in their tastes, which can result more broadly in diverse recommender needs. Thus, these groups may have different degrees of satisfaction with the provided recommendations. We explore the offline top-N performance of collaborative filtering algorithms across two domains. We find that several strategies achieve higher accuracy for dominant demographic groups, thus increasing the… 
View Paper
5 Citations
Highly Influential Citations
1
Background Citations
4
Methods Citations
2

Figures from this paper

5 Citations

Contextual Meta-Bandit for Recommender Systems Selection

This work proposes a meta-bandit that acts as a policy over options, where each option maps to a pre-trained, independent recommender system, and finds that it outperforms any of the recommenders separately, as well as an ensemble of them.

Per-Instance Algorithm Selection for Recommender Systems via Instance Clustering

This paper proposes a per-instance meta-learner that clusters data instances and predicts the best algorithm for unseen instances according to cluster membership, and explores the performances of the base algorithms on a ratings dataset and empirically shows that the error of a perfect algorithm selector monotonically decreases for larger pools of algorithm.

Travelers vs. Locals: The Effect of Cluster Analysis in Point-of-Interest Recommendation

The results on the Foursquare data set of 139,270 users in five cities show that locals, despite being the most numerous groups of users, tend to obtain lower values than the travelers in terms of ranking accuracy while these locals also seem to receive more novel and diverse POI recommendations.

One-at-a-time: A Meta-Learning Recommender-System for Recommendation-Algorithm Selection on Micro Level

This paper proposes a meta-learning-based approach to recommendation, which aims to select the best algorithm for each user-item pair, and develops a distinction between meta-learners that operate per-instance, per-data subset, and per-dataset (global level).

A Novel Approach to Recommendation Algorithm Selection using Meta-Learning

This paper proposes a meta-learning-based approach to recommendation, which aims to select the best algorithm for each user-item pair, and develops a distinction between meta-learners that operate per-instance, per-data subset, and per-dataset (global level).

8 References

Precision-oriented evaluation of recommender systems: an algorithmic comparison

In three experiments with three state-of-the-art recommenders, four of the evaluation methodologies are consistent with each other and differ from error metrics, in terms of the comparative recommenders' performance measurements.

Performance of recommender algorithms on top-n recommendation tasks

An extensive evaluation of several state-of-the art recommender algorithms suggests that algorithms optimized for minimizing RMSE do not necessarily perform as expected in terms of top-N recommendation task, and new variants of two collaborative filtering algorithms are offered.

Performance prediction and evaluation in recommender systems: An information retrieval perspective

This thesis investigates the definition and formalisation of performance predic-tion methods for recommender systems, and evaluates the quality of the proposed solutions in terms of the correlation between the predicted and the observed performance on test data.

Evaluating Recommendation Systems

This paper discusses how to compare recommenders based on a set of properties that are relevant for the application, and focuses on comparative studies, where a few algorithms are compared using some evaluation metric, rather than absolute benchmarking of algorithms.

Auditing Search Engines for Differential Satisfaction Across Demographics

A framework for internally auditing such services for differences in user satisfaction across demographic groups, using search engines as a case study is presented, and three methods for measuring latent differences inuser satisfaction from observed differences in evaluation metrics are proposed.

The MovieLens Datasets: History and Context

The history of MovieLens and the MovieLens datasets is documents, including a discussion of lessons learned from running a long-standing, live research platform from the perspective of a research organization, and best practices and limitations of using the Movie Lens datasets in new research are documented.

Rethinking the recommender research ecosystem: reproducibility, openness, and LensKit

The utility of LensKit is demonstrated by replicating and extending a set of prior comparative studies of recommender algorithms, and a question recently raised by a leader in the recommender systems community on problems with error-based prediction evaluation is investigated.

Scripts for Sturgeon and the Cool Kids: Problems with top-N Recommender Evaluation