One-sided measures for evaluating ranked retrieval effectiveness with spontaneous conversational speech

@inproceedings{Liu2006OnesidedMF,
  title={One-sided measures for evaluating ranked retrieval effectiveness with spontaneous conversational speech},
  author={Baolong Liu and Douglas W. Oard},
  booktitle={SIGIR},
  year={2006}
}
Early speech retrieval experiments focused on news broadcasts, for which adequate Automatic Speech Recognition (ASR) accuracy could be obtained. Like newspapers, news broadcasts are a manually selected and arranged set of stories. Evaluation designs reflected that, using known story boundaries as a basis for evaluation. Substantial advances in ASR accuracy now make it possible to build search systems for some types of spontaneous conversational speech, but present evaluation designs continue to… CONTINUE READING