Multi-reference WER for evaluating ASR for languages with no orthographic rules

@article{Ali2015MultireferenceWF,
  title={Multi-reference WER for evaluating ASR for languages with no orthographic rules},
  author={Ahmed M. Ali and Walid Magdy and Peter Bell and Steve Renals},
  journal={2015 IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU)},
  year={2015},
  pages={576-580}
}
Languages with no standard orthographic representation faces a challenge to evaluate the output from Automatic Speech Recognition (ASR). Since the reference transcription text can vary widely from one user to another. We propose an innovative approach for evaluating speech recognition using Multi-References. For each recognized speech segments, we ask five different users to transcribe the speech. We combine the alignment for the multiple references, and use the combined alignment to report a… CONTINUE READING