Learning from the Wisdom of Crowds by Minimax Entropy
@inproceedings{Zhou2012LearningFT, title={Learning from the Wisdom of Crowds by Minimax Entropy}, author={Dengyong Zhou and John C. Platt and Sumit Basu and Yi Mao}, booktitle={NIPS}, year={2012} }
An important way to make large training sets is to gather noisy labels from crowds of nonexperts. We propose a minimax entropy principle to improve the quality of these labels. Our method assumes that labels are generated by a probability distribution over workers, items, and labels. By maximizing the entropy of this distribution, the method naturally infers item confusability and worker expertise. We infer the ground truth by minimizing the entropy of this distribution, which we show minimizes… CONTINUE READING
Supplemental Presentations
291 Citations
Regularized Minimax Conditional Entropy for Crowdsourcing
- Computer Science, Mathematics
- ArXiv
- 2015
- 52
- PDF
Approximating Wisdom of Crowds using K-RBMs
- Computer Science, Mathematics
- ArXiv
- 2016
- Highly Influenced
- PDF
Aggregating Ordinal Labels from Crowds by Minimax Conditional Entropy
- Mathematics, Computer Science
- ICML
- 2014
- 90
- PDF
Minimax Optimal Convergence Rates for Estimating Ground Truth from Crowdsourced Labels
- Mathematics
- 2013
- 49
- PDF
Optimal Inference in Crowdsourced Classification via Belief Propagation
- Computer Science, Mathematics
- IEEE Transactions on Information Theory
- 2018
- 1
- PDF
A robust inference algorithm for crowd sourced categorization
- Computer Science
- 2017 12th International Conference on Intelligent Systems and Knowledge Engineering (ISKE)
- 2017
- 2
Boosting crowdsourcing with expert labels: Local vs. global effects
- Computer Science
- 2015 18th International Conference on Information Fusion (Fusion)
- 2015
- 3
- PDF
References
SHOWING 1-10 OF 20 REFERENCES
Combining human and machine intelligence in large-scale crowdsourcing
- Computer Science
- AAMAS
- 2012
- 318
- PDF
Quality management on Amazon Mechanical Turk
- Computer Science, Environmental Science
- HCOMP '10
- 2010
- 915
- Highly Influential
Whose Vote Should Count More: Optimal Integration of Labels from Labelers of Unknown Expertise
- Computer Science
- NIPS
- 2009
- 925
- PDF
Unifying Divergence Minimization and Statistical Inference Via Convex Duality
- Mathematics, Computer Science
- COLT
- 2006
- 120
- PDF