Topic Set Size Design with Variance Estimates from Two-Way ANOVA

@inproceedings{Sakai2014TopicSS,
  title={Topic Set Size Design with Variance Estimates from Two-Way ANOVA},
  author={Tetsuya Sakai},
  booktitle={EVIA@NTCIR},
  year={2014}
}
Recently, Sakai proposed two methods for determining the topic set size n for a new test collection based on variance estimates from past data: the first method determines the minimum n to ensure high statistical power [22], while the second method determines the minimum n to ensure tight confidence invervals [23]. These methods are based on statistical techniques described by Nagata [15]. While Sakai [22] used variance estimates based on oneway ANOVA, Sakai [23] used the 95% percentile method… CONTINUE READING