High resolution audio synchronization using chroma onset features

  title={High resolution audio synchronization using chroma onset features},
  author={S. Ewert and Meinard M{\"u}ller and Peter Grosche},
  journal={2009 IEEE International Conference on Acoustics, Speech and Signal Processing},
The general goal of music synchronization is to automatically align the multiple information sources such as audio recordings, MIDI files, or digitized sheet music related to a given musical work. In computing such alignments, one typically has to face a delicate tradeoff between robustness and accuracy. In this paper, we introduce novel audio features that combine the high temporal accuracy of onset features with the robustness of chroma features. We show how previous synchronization methods… Expand
Combination of Onset-Features with Applications to High-Resolution Music Synchronization
Many different methods for the detection of note onsets in music recordings have been proposed and applied to tasks such as music transcription, beat tracking, tempo estimation, and musicExpand
Adaptive distance normalization for real-time music tracking
  • A. Arzt, G. Widmer, S. Dixon
  • Computer Science
  • 2012 Proceedings of the 20th European Signal Processing Conference (EUSIPCO)
  • 2012
This paper first evaluates the performance of some well-known features and then proposes a simple but effective distance normalization strategy for onset-emphasized features, which greatly improves the alignment results. Expand
Extracting Predominant Local Pulse Information From Music Recordings
A novel mid-level representation that captures musically meaningful local pulse information even for the case of complex music and can be used as a flexible tool for enhancing tempo estimation and beat tracking. Expand
HReMAS: hybrid real-time musical alignment system
A real-time audio-to-score alignment system for musical applications to synchronize a live musical performance with its symbolic representation in a music sheet by enhancing it with a traceback stage, a stage used in offline alignment to improve the accuracy of the aligned note. Expand
Score-Informed Leading Voice Separation from Monaural Audio
This paper exploits the score information by constraining the source activations to conform to the aligned MIDI file, and shows that the use of these constraints can significantly improve the separation quality, in terms of both signal-based and perceptual evaluation metrics. Expand
Score-informed audio decomposition and applications
A framework for decomposing a given music recording into notewise audio events which serve as elementary building blocks is discussed and an interface that employs the additional score information to provide a natural way for a user to interact with these audio events is introduced. Expand
Compensating for asynchronies between musical voices in score-performance alignment
  • Siying Wang, S. Ewert, S. Dixon
  • Computer Science
  • 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
  • 2015
This paper presents a novel method that handles asynchronies between the melody and the accompaniment by treating the voices as separate time lines in a multi-dimensional variant of dynamic time warping (DTW). Expand
Music Signal Processing
The general goal is to show how the development of music-specific signal processing techniques is of fundamental importance for tackling otherwise infeasible music analysis problems. Expand
Estimating note intensities in music recordings
  • S. Ewert, Meinard Müller
  • Computer Science
  • 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
  • 2011
In this paper, we present automated methods for estimating note intensities in music recordings. Given a MIDI file (representing the score) and an audio recording (representing an interpretation) ofExpand
A comparative study of tonal acoustic features for a symbolic level music-to-score alignment
This paper confirms that chroma vectors drawn from representations using a logarithmic frequency scale are the most efficient features, and lead to a good precision, even with a simple alignment strategy, and shows that the relative performance of the features do not depend on possible musical score degradations. Expand


Polyphonic audio matching and alignment for music retrieval
We describe a method that aligns polyphonic audio recordings of music to symbolic score information in standard MIDI files without the difficult process of polyphonic transcription. By using thisExpand
Polyphonic Music Note Onset Detection Using Semi-Supervised Learning
It is shown that semi-supervised or bootstrapping techniques can be used to improve and adapt a general purpose onset detection algorithm for use with orchestral music. Expand
Information retrieval for music and motion
Analysis and Retrieval Techniques for Music Data, SyncPlayer: An Advanced Audio Player, and Relational Features and Adaptive Segmentation. Expand
Audio thumbnailing of popular music using chroma-based representations
This work presents a system for producing short, representative samples (or "audio thumbnails") of selections of popular music, and presents a development of the chromagram, a variation on traditional time-frequency distributions that seeks to represent the cyclic attribute of pitch perception, known as chroma. Expand
A tutorial on onset detection in music signals
Methods based on the use of explicitly predefined signal features: the signal's amplitude envelope, spectral magnitudes and phases, time-frequency representations, and methods based on probabilistic signal models are discussed. Expand
RWC Music Database: Popular, Classical and Jazz Music Databases
The design policy and specifications of the RWC Music Database are described, a music database (DB) that is available to researchers for common use and research purposes, which contains four original DBs: the Popular Music Database (100 pieces), Royalty-Free Music Database(15 pieces), Classical Music Database ($50 pieces), and Jazz Music Database (£50 pieces). Expand
Force-aligning MIDI syntheses for polyphonic music transcription generation
  • Proc. ISMIR
  • 2003
Force-aligning MIDI syntheses for polyphonic music transcription generation
  • Proc. ISMIR, Baltimore, USA, 2003.
  • 2003