Objective Measures of Perceptual Audio Quality Reviewed: An Evaluation of Their Application Domain Dependence

  title={Objective Measures of Perceptual Audio Quality Reviewed: An Evaluation of Their Application Domain Dependence},
  author={Matteo Torcoli and Thorsten Kastner and J{\"u}rgen Herre},
  journal={IEEE/ACM Transactions on Audio, Speech, and Language Processing},
Over the past few decades, computational methods have been developed to estimate perceptual audio quality. These methods, also referred to as objective quality measures, are usually developed and intended for a specific application domain. Because of their convenience, they are often used outside their original intended domain, even if it is unclear whether they provide reliable quality estimates in this case. This work studies the correlation of well-known state-of-the-art objective measures… 

Figures and Tables from this paper

Perceptual Evaluation of 360 Audiovisual Quality and Machine Learning Predictions
Perceived audiovisual quality prediction based on objective quality metrics and subjective scores of 360 video and spatial audio content and the results indicate that the model based on the evaluation of VMAF and AMBIQUAL is better than other combinations of audio-video quality metric.
Controlling the Remixing of Separated Dialogue with a Non-Intrusive Quality Estimate
The non-intrusive estimate nDNN2f is mapped to select item-dependent remixing gains with the aim of maximizing the interferer attenuation under a constraint on the minimum quality of the remixed output.
A Hands-on Comparison of DNNs for Dialog Separation Using Transfer Learning from Music Source Separation
The results indicate that pre-trained music source separation models can be used for dialog separation to some degree, and that they benefit from the fine-tuning, reaching a performance close to task-specific solutions.


Comparing the Effect of Audio Coding Artifacts on Objective Quality Measures and on Subjective Ratings
These ratings from an extensive perceptual quality evaluation of audio signals are used as perceptual reference for studying the performance of 11 well-known tools for objective audio quality evaluation, finding no tool reliably assesses artifacts from parametric audio coding.
Subjective and objective quality assessment of single-channel speech separation algorithms
Comparing subjective and objective measurements shows that PESQ and PEASS quality metrics predict well the subjective quality of separated signals obtained by the separation systems.
Can We Still Use PEAQ? A Performance Analysis of the ITU Standard for the Objective Assessment of Perceived Audio Quality
  • Pablo Delgado, J. Herre
  • Computer Science
    2020 Twelfth International Conference on Quality of Multimedia Experience (QoMEX)
  • 2020
Results indicate that the performance of PEAQ's model of disturbance loudness is still as good as (and sometimes superior to) other state-of-the-art objective measures, albeit with varying performance depending on the type of degraded signal content (i.e. speech or music).
Subjective and Objective Quality Assessment of Audio Source Separation
A family of objective measures aiming to predict subjective scores based on the decomposition of the estimation error into several distortion components and on the use of the PEMO-Q perceptual salience measure to provide multiple features that are then combined are proposed.
Subjective and Objective Assessment of Perceived Audio Quality of Current Digital Audio Broadcasting Systems and Web-Casting Applications
It is shown that a retrained POLQA Music provides the best overall correlations between predicted objective measurements and subjective scores allowing to predict the final perceived quality with good accuracy when scores are averaged over a small set of musical fragments.
An Objective Metric of Human Subjective Audio Quality Optimized for a Wide Range of Audio Fidelities
The goal of this paper is to develop an audio quality metric that can accurately quantify subjective quality over audio fidelities ranging from highly impaired to perceptually lossless, and to combine these MOVs into a single quality measure that is both accurate and robust.
PEMO-Q—A New Method for Objective Audio Quality Assessment Using a Model of Auditory Perception
  • R. Huber, B. Kollmeier
  • Computer Science
    IEEE Transactions on Audio, Speech, and Language Processing
  • 2006
A new method for the objective assessment and prediction of perceived audio quality is introduced, based on a psychoacoustically validated, quantitative model of the "effective" peripheral auditory processing, which shows a higher prediction accuracy than the ITU-R recommendation BS.1387.
An Efficient Model for Estimating Subjective Quality of Separated Audio Source Signals
  • T. Kastner, J. Herre
  • Computer Science
    2019 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA)
  • 2019
A model for prediction of the perceived audio quality of separated audio source signals is presented, solely based on two timbre features and demanding less computational effort than current perceptual measurement schemes for audio source separation.
Objective Assessment of Speech and Audio Quality - Technology and Applications
An overview of the field is provided, outlining the main approaches to intrusive, nonintrusive and parametric models and discussing some of their limitations and areas of future work.
Modeling Perceptual Similarity of Audio Signals for Blind Source Separation Evaluation
A strong correlation is shown between a linear combination of a subset of four of these parameters and mean human assessments, and this correlation is stronger than that between human assessments and several measures currently in use.