# Pranking with Ranking

@inproceedings{Crammer2001PrankingWR, title={Pranking with Ranking}, author={Koby Crammer and Yoram Singer}, booktitle={NIPS}, year={2001} }

We discuss the problem of ranking instances. In our framework each instance is associated with a rank or a rating, which is an integer from 1 to k. Our goal is to find a rank-predict ion rule that assigns each instance a rank which is as close as possible to the instance's true rank. We describe a simple and efficient online algorithm, analyze its performance in the mistake bound model, and prove its correctness. We describe two sets of experiments, with synthetic data and with the EachMovie…

## Topics from this paper

## 655 Citations

Online Ranking by Projecting

- Computer Science, MathematicsNeural Computation
- 2005

The goal is to find a rank-prediction rule that assigns each instance a rank that is as close as possible to the instance's true rank.

Proceedings of the NIPS 2005 Workshop on Learning to Rank

- 2005

In label-ranking, the goal is to learn a mapping from instances to rankings (total orders) over a fixed set of labels. Hitherto existing approaches to label-ranking implicitly operate on an…

Optimization of Ranking Measures

- 2007

Web page ranking requires the optimization of sophisticated performance measures. Current approaches only minimize measures indirectly related to performance scores. We present a new approach which…

Direct Learning to Rank and Rerank

- Computer Science, MathematicsAISTATS
- 2018

It is proved that a relaxed version of the "exact" problem has the same optimal solution, and an empirical analysis is provided that shows the possibility of "exactly" reranking algorithms based on mathematical programming.

Direct optimization of ranking measures for learning to rank models

- Computer Science, MathematicsKDD
- 2013

A novel learning algorithm is presented, DirectRank, which directly and exactly optimizes ranking measures without resorting to any upper bounds or approximations, and a probabilistic framework for document-query pairs is constructed to maximize the likelihood of the objective permutation of top-$\tau$ documents.

Generalization Bounds for k-Partite Ranking

- Mathematics
- 2005

We study generalization properties of ranking algorithms in the setting of the k-partite ranking problem. In the k-partite ranking problem, one is given examples of instances labeled with one of k…

Magnitude-preserving ranking algorithms

- Mathematics, Computer ScienceICML '07
- 2007

This paper describes and analyzes several algorithms for ranking when one wishes not just to accurately predict pairwise ordering but also preserve the magnitude of the preferences or the difference between ratings, extending previously known stability results to non-bipartite ranking and magnitude of preference-preserving algorithms.

Ranking with decision tree

- Computer ScienceKnowledge and Information Systems
- 2007

A new splitting rule is presented that introduces a metric, i.e., an impurity measure, to construct decision trees for ranking tasks, which outperforms both perceptron-based ranking and the classification tree algorithms in term of accuracy as well as speed.

Direct Optimization of Ranking Measures

- Computer ScienceArXiv
- 2007

Key to the approach is that during training the ranking problem can be viewed as a linear assignment problem, which can be solved by the Hungarian Marriage algorithm, and a sort operation is sufficient, as the algorithm assigns a relevance score to every document, query pair.

A fast algorithm for learning large scale preference relations

- Mathematics, Computer ScienceAISTATS
- 2007

Experiments on public benchmarks for ordinal regression and collaborative filtering show that the proposed algorithm is as accurate as the best available methods in terms of ranking accuracy, when trained on the same data, and is several orders of magnitude faster.

## References

SHOWING 1-10 OF 15 REFERENCES

Learning to Order Things

- Computer Science, MathematicsNIPS
- 1997

An on-line algorithm for learning preference functions that is based on Freund and Schapire's "Hedge" algorithm is considered, and it is shown that the problem of finding the ordering that agrees best with a learned preference function is NP-complete.

An Efficient Boosting Algorithm for Combining Preferences

- Computer ScienceJ. Mach. Learn. Res.
- 1998

This work describes and analyze an efficient algorithm called RankBoost for combining preferences based on the boosting approach to machine learning, and gives theoretical results describing the algorithm's behavior both on the training data, and on new test data not seen during training.

Ultraconservative Online Algorithms for Multiclass Problems

- Computer ScienceJ. Mach. Learn. Res.
- 2003

This paper studies online classification algorithms for multiclass problems in the mistake bound model and introduces the notion of ultracon-servativeness, a family of additive ultraconservative algorithms where each algorithm in the family updates its prototypes by finding a feasible solution for a set of linear constraints that depend on the instantaneous similarity-scores.

Advances in Large Margin Classifiers

- Computer Science
- 2000

This book provides an overview of recent developments in large margin classifiers, examines connections with other methods, and identifies strengths and weaknesses of the method, as well as directions for future research.

Large Margin Classification Using the Perceptron Algorithm

- Computer ScienceCOLT' 98
- 1998

A new algorithm for linear classification which combines Rosenblatt's perceptron algorithm with Helmbold and Warmuth's leave-one-out method is introduced, which is much simpler to implement, and much more efficient in terms of computation time.

Statistical learning theory

- Computer Science
- 1998

Presenting a method for determining the necessary and sufficient conditions for consistency of learning process, the author covers function estimates from small data pools, applying these estimations to real-life problems, and much more.

Mathematical models in the social sciences

- Computer Science
- 1972

Republication of this book provides social science and mathematics students with a text that is the analogue of mathematical methods textbooks used in the study of the physical sciences and engineering.

Schapire , and Yoram Singer . Learning to order things

- Journal of Artificial Intelligence Research
- 1999