A Statistical Evaluation of Recent Full Reference Image Quality Assessment Algorithms

  title={A Statistical Evaluation of Recent Full Reference Image Quality Assessment Algorithms},
  author={Hamid R. Sheikh and Muhammad F. Sabir and Alan Conrad Bovik},
  journal={IEEE Transactions on Image Processing},
Measurement of visual quality is of fundamental importance for numerous image and video processing applications, where the goal of quality assessment (QA) algorithms is to automatically assess the quality of images or videos in agreement with human quality judgments. [] Key Result This would allow other researchers to easily report comparative results in the future


An up-to-date review on IQA research and its future trends, the principles and methodologies used in popular Full Reference IQA algorithms, the methodologies and parameters used for evaluating the performance ofIQA algorithms and performance comparison of important IQAgorithms are presented.

A Comprehensive Performance Evaluation of Image Quality Assessment Algorithms

This work carries out the largest performance evaluation study so far on FR fusion methods, and an important discovery is that rank aggregation based FR fusion is able to outperform not only other FR fusion approaches but also the top performing FR methods.

Survey of quality score calculation for human visual perception of an image

Reduced reference image quality assessment (RR IQA) gives a realistic solution for automatic image quality estimation in different kinds of applications where only partial information of the original or reference image is available.

A comprehensive evaluation of full reference image quality assessment algorithms

This paper reports the performance of eleven selected FR IQA algorithms on all the seven public IQA image datasets and hopes that the evaluation results and the associated discussions will be very helpful for relevant researchers to have a clearer understanding about the status of modernFR IQA indices.

Study of Subjective and Objective Quality Assessment of Video

A recent large-scale subjective study of video quality on a collection of videos distorted by a variety of application-relevant processes results in a diverse independent public database of distorted videos and subjective scores that is freely available.

Blind image quality assessment based on aesthetic and statistical quality-aware features

A host of features that are commonly employed in image aesthetics assessment are used to improve blind image quality assessment (BIQA) methods accuracy by integrating a host of aesthetics image features with the features of natural image statistics derived from multiple domains.

A Human Perception Based Performance Evaluation of Image Quality Metrics

Different state of the art full-reference objective image quality metrics (IQMs) are evaluated against human subjective judgments on standard LIVE image quality database and it is observed that though there is not a single winner, VIF and IFC seem to have a higher performance compared to other quality metrics.

Full-reference visual quality assessment for synthetic images: A subjective study

Measuring visual quality, as perceived by human observers, is becoming increasingly important in the many applications in which humans are the ultimate consumers of visual information. For assessing

A Survey on Image Quality Assessment

The concepts and metrics of image quality assessment and also video quality assessment are reviewed, some methods of full-reference and semi-reference imagequality assessment are introduced, and the commonly used synthetic database and real-world database are introduced.



A comparison of image quality models and metrics based on human visual sensitivity

The results show that these metrics are highly correlated with the subjective quality grading but also depends on the complexity of the images under study, which can be improved by integrating all masking effects and typical artifacts of the compression method.

An information fidelity criterion for image quality assessment using natural scene statistics

This paper proposes a novel information fidelity criterion that is based on natural scene statistics and derives a novel QA algorithm that provides clear advantages over the traditional approaches and outperforms current methods in testing.

Image information and visual quality

  • H. SheikhA. Bovik
  • Computer Science
    2004 IEEE International Conference on Acoustics, Speech, and Signal Processing
  • 2004
This work proposes an information fidelity criterion that quantifies the Shannon information that is shared between the reference and distorted images relative to the information contained in the reference image itself, and demonstrates the performance of the algorithm by testing it on a data set of 779 images.

Comparison of two image quality models

The comparison of these two models is presented in the context of the research interests which are image quality evaluation for both computer imaging and computer graphics tasks.

Using similarity measures and homogeneity for the comparison of images

Stimulus synthesis for efficient evaluation and refinement of perceptual image quality metrics

This methodology starts from an initial distorted image and iteratively search for the best/worst images in terms of one metric while constraining the value of the other to remain fixed, reversing the roles of the two metrics.

Image quality assessment based on a degradation model

It is demonstrated how to decouple distortion and additive noise degradation in a practical image restoration system and the nonlinear NQM is a better measure of visual quality than peak signal-to noise ratio (PSNR) and linear quality measures.

Statistical evaluation of image quality measures

It was found that measures based on the phase spectrum, the multireso- lution distance or the HVS filtered mean square error are computa- tionally simple and are more responsive to coding artifacts.

Quality asessment of coded images using numerical category scaling

A number of simple techniques that can be used to assess perceived image quality are discussed and it is demonstrated that the results from a numerical scaling experiment depend on the specific nature of the subject's task in combination with the nature ofThe images to be judged.

Objective picture quality scale (PQS) for image coding

A new methodology for the determination of an objective metric for still image coding is reported, and the PQS closely approximates the MOS, with a correlation coefficient of more than 0.92.