Audio Music Similarity and Retrieval: Evaluation Power and Stability

@inproceedings{Urbano2011AudioMS,
  title={Audio Music Similarity and Retrieval: Evaluation Power and Stability},
  author={Juli{\'a}n Urbano and Diego Mart{\'i}n and M{\'o}nica Marrero and Jorge Morato},
  booktitle={ISMIR},
  year={2011}
}
In this paper we analyze the reliability of the res ults in the evaluation of Audio Music Similarity and Retrieval systems. We focus on the power and stability of the evaluati on, that is, how often a significant difference is found bet w en systems and how often these significant differences ar e incorrect. We study the effect of using different effect iveness measures with different sets of relevance judgments , for varying number of queries and alternative statistic al procedures. Different… CONTINUE READING

From This Paper

Figures, tables, and topics from this paper.

References

Publications referenced by this paper.
Showing 1-10 of 18 references

On the Reliability of Information Re trieval Metrics Based on Graded Relevance

  • T. Sakai
  • Information Processing and Management, 43:2, pp…
  • 2007
Highly Influential
4 Excerpts

MIREX Next Generation

  • J. S. Downie
  • music-ir email list, 2011. Available at: http…
  • 2011

MIREX 2009 Audio Music Similarity and Retrieval Results

  • IMIRSEL
  • http://musicir.org/mirex/wiki/2009…
  • 2009
1 Excerpt

Similar Papers

Loading similar papers…