Tasks, topics and relevance judging for the TREC Genomics Track: five years of experience evaluating biomedical text information retrieval systems

@article{Roberts2008TasksTA,
  title={Tasks, topics and relevance judging for the TREC Genomics Track: five years of experience evaluating biomedical text information retrieval systems},
  author={Phoebe M. Roberts and Aaron M. Cohen and William R. Hersh},
  journal={Information Retrieval},
  year={2008},
  volume={12},
  pages={81-97}
}
With the help of a team of expert biologist judges, the TREC Genomics track has generated four large sets of “gold standard” test collections, comprised of over a hundred unique topics, two kinds of ad hoc retrieval tasks, and their corresponding relevance judgments. Over the years of the track, increasingly complex tasks necessitated the creation of judging tools and training guidelines to accommodate teams of part-time short-term workers from a variety of specialized biological scientific… CONTINUE READING

Citations

Publications citing this paper.
Showing 1-10 of 23 extracted citations

References

Publications referenced by this paper.
Showing 1-10 of 22 references

Comparative analysis of five protein-protein interaction corpora

  • S. Pyysalo, A Airola
  • BMC Bioinformatics,
  • 2008

Essie: A concept-based search engine for structured biomedical text

  • N. C. Ide, Loane, F R.
  • Journal of the American Medical Informatics…
  • 2007
1 Excerpt

Similar Papers

Loading similar papers…