Comparing Human and Machine Performance for Natural Language Information Extraction: Results from the Tipster Text Evaluation

@inproceedings{Will1993ComparingHA,
  title={Comparing Human and Machine Performance for Natural Language Information Extraction: Results from the Tipster Text Evaluation},
  author={Craig A. Will},
  booktitle={TIPSTER},
  year={1993}
}
This paper presents results from a study comparing human performance on the text of natural language information extraction with that of machine extraction systems that were developed as part of the ARPA Tipster program. Information extraction is shown to be a difficult task for both humans and machines. Evidence for one set of text material, English Microelectronics, indicated that a human analyst produces about half the errors as does machine systems. I N T R O D U C T I O N In evaluating the… CONTINUE READING
11 Citations
7 References
Similar Papers

References

Publications referenced by this paper.
Showing 1-7 of 7 references

MUC-5 Evaluation Metrics." Proceedings of the Fifth Message Understanding Conference (MUC-5)

  • Chinchor, Nancy, Sundheim, Beth
  • 1993
Highly Influential
5 Excerpts

Issues in the Design of Human-Machine Systems for Natural Language Information Extraction." Presented at the 18-month Tipster meeting

  • Will, A Craig, Reeker, H Larry
  • February 22-24,
  • 1993
2 Excerpts

Overview of the Fourth Message Understanding Evaluation and Conference." Proceedings of the Fourth Message Understanding Conference (MUC-4) (p

  • Sundheim, Beth
  • June 16-18,
  • 1992
1 Excerpt

Similar Papers

Loading similar papers…