Toward the scientific evaluation of music information retrieval systems

@inproceedings{Downie2003TowardTS,
  title={Toward the scientific evaluation of music information retrieval systems},
  author={J. Stephen Downie},
  booktitle={ISMIR},
  year={2003}
}
This paper outlines the findings-to-date of a project to assist in the efforts being made to establish a TREC-like evaluation paradigm within the Music Information Retrieval (MIR) research community. The findings and recommendations are based upon expert opinion garnered from members of the Information Retrieval (IR), Music Digital Library (MDL) and MIR communities with regard to the construction and implementation of scientifically valid evaluation frameworks. Proposed recommendations include… CONTINUE READING
Highly Cited
This paper has 43 citations. REVIEW CITATIONS
31 Citations
42 References
Similar Papers

Citations

Publications citing this paper.

References

Publications referenced by this paper.
Showing 1-10 of 42 references

Music GRID: A collaborative virtual organization for music information retrieval collaboration and evaluation

  • M. J. Dovey
  • In The MIR/MDL Evaluation Project White Paper…
  • 2002
Highly Influential
5 Excerpts

Evaluation in information retrieval

  • J. Reiss, M. Sandler
  • The MIR / MDL Evaluation Project White Paper…
  • 2002
Highly Influential
4 Excerpts

A Framework for the evaluation of content - based music information retrieval using the TREC Paradigm

  • L. Schamber
  • The MIR / MDL Evaluation Project White Paper…
  • 2002

Similar Papers

Loading similar papers…