Skip to search formSkip to main contentSkip to account menu
Music Information Retrieval: Recent Developments and Applications
We provide a survey of the field of Music Information Retrieval (MIR), in particular paying attention to latest developments, such as semantic auto-tagging and user-centric retrieval and…
View via Publisher
Named Entity Recognition: Fallacies, challenges and opportunities
View via Publisher
The neglected user in music information retrieval research
TLDR
This article investigates and discusses literature on the topic of user-centric music retrieval and reflects on why the breakthrough in this field has not been achieved yet, and presents ideas on aspects crucial to consider when elaborating user-aware music retrieval systems.
View on Springer
Evaluation in Music Information Retrieval
TLDR
A survey of past evaluation work in the context of Text IR, from the point of view of validity, reliability and efficiency of the experiments is presented.
View on Springer
The MediaEval 2018 AcousticBrainz Genre Task: Content-based Music Genre Recognition from Multiple Sources
Comunicacio presentada al MediaEval 2018 Workshop celebrat a Sophia Antipolis (Franca) del 29 al 31 d'octubre de 2018.
View Paper
Statistical Significance Testing in Information Retrieval: An Empirical Analysis of Type I, Type II and Type III Errors
TLDR
Having such a large supply of IR evaluation data with full knowledge of the null hypotheses, this study is finally in a position to evaluate how well statistical significance tests really behave with IR data, and make sound recommendations for practitioners.
View on ACM
On the measurement of test collection reliability
TLDR
This work empirically established relationships based on data from over 40 TREC collections, thus filling the gap in the practical interpretation of Generalizability Theory, and discusses the computation of confidence intervals for these statistics, providing a much more reliable tool to measure test collection reliability.
View on ACM
A comparison of the optimality of statistical significance tests for information retrieval evaluation
TLDR
A large-scale study comprising nearly 60 million system comparisons showing that in practice the bootstrap, t-test and Wilcoxon test outperform the permutation test under different optimality criteria.
View on ACM
Test collection reliability: a study of bias and robustness to statistical assumptions via stochastic simulation
  • Julián Urbano
  • Computer Science
    Information Retrieval Journal
  • 1 June 2016
TLDR
A method for stochastic simulation of evaluation results under different statistical assumptions is detail, which can be used for a variety of evaluation research where the authors need to know the true scores of systems.
View on Springer
Current Challenges in the Evaluation of Predominant Melody Extraction Algorithms
TLDR
The results show that the clips currently used are too short to predict performance on full songs, highlighting the paramount need to use complete musical pieces and the need for new and larger collections containing realistic music material, for reliable and meaningful evaluation of Audio Melody Extraction.
...
...
By clicking accept or continuing to use the site, you agree to the terms outlined in our Privacy Policy, Terms of Service, and Dataset License