3D video subjective quality: a new database and grade comparison study

  title={3D video subjective quality: a new database and grade comparison study},
  author={Emil Dumic and Sonja Grgic and Kresimir Sakic and Pedro Miguel Regalo Rocha and Lu{\'i}s Alberto da Silva Cruz},
  journal={Multimedia Tools and Applications},
This paper presents a research study on the subjective assessment of 3D video quality using a newly constructed 3D video database (3DVCL@FER. [] Key Method The subjective assessment was done with the support of a purpose-built easily customizable grade collection platform and conducted in two research laboratories, in Croatia and Portugal. Subjective scores for quality, depth and comfort were collected and DMOS (Difference Mean Opinion Score) values were calculated. Different objective measures (for image…
Perceptual quality assessment of 3D videos with stereoscopic degradations
A psychophysical experiment is performed to analyze the perceived quality and comfort of 3D videos containing stereoscopic degradations and shows that users that have little familiarity with 3D content have difficulties identifying stereoscopic distortions.
Crowdsourced subjective 3D video quality assessment
This article proposes a new method for subjective 3D video quality assessment based on crowdsourced workers—Crowd3D, which can be used with advantage for further related research activities, reducing the time and cost compared to the traditional laboratory-based quality assessments.
A depth perception evaluation metric for immersive user experience towards 3D multimedia services
It can be clearly stated that the provision of better 3D video experience to the end users can be accelerated in a timely fashion for the Future Internet multimedia services.
Study of Subjective Quality and Objective Blind Quality Prediction of Stereoscopic Videos
The proposed algorithm, which is completely blind (requiring no reference videos or training on subjective scores) is called the Motion and Disparity-based 3D video quality evaluator (MoDi3D), which delivers competitive performance over a wide variety of datasets, including the IRCCYN dataset, the WaterlooIVC Phase I datasets, the LFOVIA dataset, and the proposed LFOVIAS3DPh2 S3D video dataset.
Asymmetrically Compressed Stereoscopic 3D Videos: Quality Assessment and Rate-Distortion Performance Evaluation
A binocular rivalry inspired model is applied to account for the prediction bias, leading to a significantly improved full reference quality prediction model of stereoscopic videos that allows us to quantitatively predict the coding gain of different variations of asymmetric video compression, and provides new insight on the development of high efficiency 3D video coding schemes.
The influence of 3D video artifacts on discomfort of 302 viewers
A method of automatic subjective quality evaluation that uses technical parameters of stereoscopic scenes, based on subjective scores and brain-activity measurements using electroencephalography (EEG) to assess viewer discomfort is proposed.
Toward the Assessment of Quality of Experience for Asymmetric Encoding in Immersive Media
The focus of this contribution is the development of a QoE assessment framework, in line with the latest standardization progress in the field of QOE assessment, for understanding the visual effect of asymmetric and symmetric encoding for immersive media.
Subjective quality assessment of stereo image compression based on stereoscopic fusion in binocular vision
This method exploited the correlation between the left and right frames of the given sequence that can not only help achieving certain efficiency of stereo image transmission but also facilitate the consistency of the directly intuitive output evaluation value and the sensitivity of stereoscopic perception.
3D Video Tools
This chapter presents an overview of different tools used in research and engineering of 3D video delivery systems. These include software tools for 3D video compression and streaming, 3D video


A comprehensive database and subjective evaluation methodology for quality of experience in stereoscopic video
A comprehensive stereoscopic video database that contains a large variety of scenes captured using a stereoscopic camera setup consisting of two HD camcorders with different capture parameters and provides subjective quality scores obtained using a tailored single stimulus continuous quality scale (SSCQS) method.
NAMA3DS1-COSPAD1: Subjective video quality assessment database on coding conditions introducing freely available high quality 3D stereoscopic sequences
A freely available dataset of high quality Full-HD stereoscopic sequences shot with a semiprofessional 3D camera is introduced in detail, designed to be suited for usage in a wide variety of applications, including high quality studies.
Benchmark of state of the art objective measures for 3D stereoscopic video quality assessment on the Nantes database
Results show that in some cases, image quality measures give better results than video quality measures, which means that more effort should be devoted to designing new 3D video quality assessment measures.
Perceptual Video Quality Metric for 3D video quality assessment
The proposed Perceptual Quality Metric (PQM) shows better results for 3D video quality evaluation and outperforms the Video Quality Metrics (VQM); as it is sensitive to slight changes in image degradation and error quantification starts at pixel level right up to the sequence level.
Objective image quality assessment of 3D synthesized views
Quality Assessment of Stereoscopic 3D Image Compression by Binocular Integration Behaviors
The binocular integration behaviors-the binocular combination and the binocular frequency integration, are utilized as the bases for measuring the quality of stereoscopic 3D images and it is found that the proposed metrics can also address the quality assessment of the synthesized color-plus-depth3D images well.
STESCAL3D: Subjective evaluation of HD stereo video streaming using H.264 SVC in diverse laboratory environments
A new 3D video database made up of 3D stereo video sequences affected by different types of degradations is presented, showing that stereo-view asymmetries in terms of encoding parameters and packet loss ratio (PLR) leads to low quality of experience.
Subjective evaluation of stereoscopic image quality
Toward an Impairment Metric for Stereoscopic Video: A Full-Reference Video Quality Metric to Assess Compressed Stereoscopic Video
The proposed metric performs significantly better than state-of-the-art stereoscopic image and video quality metrics in predicting the subjective scores and will have important uses in advanced 3D media delivery systems.
Stereoscopic quality datasets under various test conditions
Three visual quality datasets are published, including crosstalk stereoscopic (relates cOSstalk perception to scene content, cros stalk level and camera baseline), crosStalk auto-stereoscopic ( relates cros Stereoscopic perception toscene content), and QoE stereoscopic and results analysis are detailed in the paper.