Empirical Evaluation of Voting Rules with Strictly Ordered Preference Data

@inproceedings{Mattei2011EmpiricalEO,
  title={Empirical Evaluation of Voting Rules with Strictly Ordered Preference Data},
  author={Nicholas Mattei},
  booktitle={Algorithmic Decision Theory},
  year={2011}
}
  • Nicholas Mattei
  • Published in Algorithmic Decision Theory 26 October 2011
  • Economics, Computer Science
The study of voting systems often takes place in the theoretical domain due to a lack of large samples of sincere, strictly ordered voting data.We derive several million elections (more than all the existing studies combined) from a publicly available data, the Netflix Prize dataset. The Netflix data is derived from millions of Netflix users, who have an incentive to report sincere preferences, unlike random survey takers. We evaluate each of these elections under the Plurality, Borda, k… 

An Empirical Study of Voting Rules and Manipulation with Large Datasets

The study of voting systems often takes place in the theoretical domain due to a lack of large samples of sincere, strictly ordered voting data. We derive several million elections (more than all the

Heuristics in Multi-Winner Approval Voting

It is shown that people generally manipulate their vote to obtain a better outcome, but often do not identify the optimal manipulation, and instead, voters tend to prioritize the candidates with the highest utilities.

The Random Pairs Voting Rule : Introduction and Evaluation With a Large Dataset

The Random Pairs voting rule is compared to plurality, 2-approval, Borda, and range voting on elections constructed from Yahoo! users’ ratings of musical artists to show it significantly improves upon the communication complexity of balloting methods requiring complete orderings of candidates while maintaining a high Condorcet efficiency.

Winner Determination under Common Voting Rules using Truncated Ballots. (Détermination du gagnant à partir des règles de vote communes à l'aide des bulletins tronqués)

This dissertation focuses on voting with partial preferences in the form of top-k ballots and proposes and analyze different methods allowing a compromise between the accuracy of the result and the amount of communication required; some require only one round of communication, while others are interactive.

Collecting, Classifying, Analyzing, and Using Real-World Elections

A collection of 7582 real-world elections from 25 datasets from various sources ranging from sports competitions over music charts to survey- and indicator-based rankings is presented to evaluate the practical applicability of previous theoretical research on (pa-rameterized) algorithms.

Voting with Rank Dependent Scoring Rules

A new family of voting rules, rank-dependent scoring rules (RDSRs), based on ordered weighted average (OWA) operators are defined, which, include all scoring rules, and many others, most of which of new.

Representing the Insincere: Strategically Robust Proportional Representation

It is shown that there is no PR-based voting rule which ensures that every equilibrium satisfies PR, and the possibility and limit of achieving PR in the presence of strategic voters are highlighted.

Decision making under uncertainty: theoretical and empirical results on social choice, manipulation, and bribery

This work investigates the situations where the agents have access to perfect information, uncertain information, and structured preference information and finds that the complexity of the bribery and manipulation problems can range from computationally easy to computationally intractable.

The aggregation paradox for statistical rankings and nonparametric tests

Using the binomial(n, p = 0.5) random variable CDF, it is proved that aggregation of r(≥2) constituent data sets—each rendering a qualitatively-equivalent sign test for matched pairs result—reinforces and strengthens constituent results (sign test consistency).

Developing the aggregate empirical side of computational social choice

It is shown that the simulated voting situations of a statistical model capable of generating voting situations for three-candidate elections that have a distribution very similar to that of observed voting situations can provide interesting insights into the question of which voting rule is most likely to identify the best candidate.

References

SHOWING 1-10 OF 28 REFERENCES

Condorcet's paradox and the likelihood of its occurrence: different perspectives on balanced preferences*

Many studies have considered the probability that a pairwise majority rule (PMR) winner exists for three candidate elections. The absence of a PMR winner indicates an occurrence of Condorcet's

A Comparison of Efficiency of Multicandidate Electoral Systems

A variety of electoral systems for single-winner, multicandidate elections are evaluated according to their tendency to (a) select the Condorcet candidate-the candidate who could beat each of the

Modeling the Outcomes of Vote-Casting in Actual Elections

How often do events of interest to voting theorists occur in actual elections? For example, what is the probability of observing a voting cycle – an outcome in which no candidate beats all other

The occurrence of the paradox of voting in University elections

Despite its theoretical importance for both normative and descriptive concerns, political scientists have largely ignored the paradox of voting because of the lack of solid evidence that it ever

An Empirical Study of the Manipulability of Single Transferable Voting

  • T. Walsh
  • Economics, Computer Science
    ECAI
  • 2010
Empirically, the manipulability of single transferable voting (STV) is studied to determine if computational complexity is really a barrier to manipulation.

The Unexpected Empirical Consensus Among Consensus Methods

This work analyzed four elections of the American Psychological Association using a state-of-the-art multimodel, multimethod approach and found strong statistical support for an unexpected degree of empirical consensus among them in these elections.

Common Voting Rules as Maximum Likelihood Estimators

Voting is a very general method of preference aggregation that takes as input every voter's vote, and produces as output either just the winning alternative or a ranking of the alternatives.

Where are the hard manipulation problems?

  • T. Walsh
  • Computer Science, Economics
    J. Artif. Intell. Res.
  • 2011
Empirical studies are shown to be useful in improving the understanding of computational complexity in voting and manipulation, and two settings are considered which represent the two types of complexity results: manipulation with unweighted votes by a single agent, and manipulation with weighted Votes by a coalition of agents.

An Empirical Evaluation of Six Voting Procedures: Do They Really Make Any Difference?

Six single- or multi-winner voting procedures are compared to one another in terms of the outcomes of thirty-seven real elections conducted in Britain by various trade unions, professional

When are elections with few candidates hard to manipulate?

This article characterize the exact number of candidates for which manipulation becomes hard for the plurality, Borda, STV, Copeland, maximin, veto, plurality with runoff, regular cup, and randomized cup protocols and shows that for simpler manipulation problems, manipulation cannot be hard with few candidates.