Analysis of Crowdsourced Sampling Strategies for HodgeRank with Sparse Random Graphs

@article{Osting2015AnalysisOC,
  title={Analysis of Crowdsourced Sampling Strategies for HodgeRank with Sparse Random Graphs},
  author={Braxton Osting and Jiechao Xiong and Qianqian Xu and Yuan Yao},
  journal={CoRR},
  year={2015},
  volume={abs/1503.00164}
}
Crowdsourcing platforms are now extensively used for conducting subjective pairwise comparison studies. In this setting, a pairwise comparison dataset is typically gathered via random sampling, either with or without replacement. In this paper, we use tools from random graph theory to analyze these two random sampling methods for the HodgeRank estimator. Using the Fiedler value of the graph as a measurement for estimator stability (informativeness), we provide a new estimate of the Fiedler… CONTINUE READING