A Novel No-Reference Quality Assessment Metric for Stereoscopic Images with Consideration of Comprehensive 3D Quality Information

被引:1
|
作者
Shen, Liquan [1 ]
Yao, Yang [1 ]
Geng, Xianqiu [1 ]
Fang, Ruigang [2 ]
Wu, Dapeng [2 ]
机构
[1] Shanghai Univ, Shanghai Inst Adv Commun & Data Sci, Shanghai 200444, Peoples R China
[2] Univ Florida, Dept Elect & Comp Engn, Gainesville, FL 32603 USA
基金
中国国家自然科学基金;
关键词
no reference; stereoscopic image quality assessment; spatial domain; transform domain; stereo visual information; natural scene statistics; machine learning; VISUAL-ATTENTION; COMPRESSION; MODELS;
D O I
10.3390/s23136230
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Recently, stereoscopic image quality assessment has attracted a lot attention. However, compared with 2D image quality assessment, it is much more difficult to assess the quality of stereoscopic images due to the lack of understanding of 3D visual perception. This paper proposes a novel no-reference quality assessment metric for stereoscopic images using natural scene statistics with consideration of both the quality of the cyclopean image and 3D visual perceptual information (binocular fusion and binocular rivalry). In the proposed method, not only is the quality of the cyclopean image considered, but binocular rivalry and other 3D visual intrinsic properties are also exploited. Specifically, in order to improve the objective quality of the cyclopean image, features of the cyclopean images in both the spatial domain and transformed domain are extracted based on the natural scene statistics (NSS) model. Furthermore, to better comprehend intrinsic properties of the stereoscopic image, in our method, the binocular rivalry effect and other 3D visual properties are also considered in the process of feature extraction. Following adaptive feature pruning using principle component analysis, improved metric accuracy can be found in our proposed method. The experimental results show that the proposed metric can achieve a good and consistent alignment with subjective assessment of stereoscopic images in comparison with existing methods, with the highest SROCC (0.952) and PLCC (0.962) scores being acquired on the LIVE 3D database Phase I.
引用
收藏
页数:24
相关论文
共 50 条
  • [1] No-Reference Stereoscopic Image Quality Assessment Based on Image Distortion and Stereo Perceptual Information
    Shen, Liquan
    Fang, Ruigang
    Yao, Yang
    Geng, Xianqiu
    Wu, Dapeng
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2019, 3 (01): : 59 - 72
  • [2] A NO-REFERENCE STEREOSCOPIC QUALITY METRIC
    Silva, Alessandro R.
    Melgar, Max E. Vizcarra
    Farias, Mylene C. Q.
    THREE-DIMENSIONAL IMAGE PROCESSING, MEASUREMENT (3DIPM), AND APPLICATIONS 2015, 2015, 9393
  • [3] No-Reference Quality Assessment for Stereoscopic Images Based on Binocular Quality Perception
    Ryu, Seungchul
    Sohn, Kwanghoon
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2014, 24 (04) : 591 - 602
  • [4] 3D saliency guided deep quality predictor for no-reference stereoscopic images
    Messai, Oussama
    Chetouani, Aladine
    Hachouf, Fella
    Seghir, Zianou Ahmed
    NEUROCOMPUTING, 2022, 478 : 22 - 36
  • [5] A no-reference quality assessment metric for dynamic 3D digital human
    Chen, Shi
    Zhang, Zicheng
    Zhou, Yingjie
    Sun, Wei
    Min, Xiongkuo
    DISPLAYS, 2023, 80
  • [6] Learning based no-reference metric for assessing quality of experience of stereoscopic images
    Liu, Tsung-Jung
    Liu, Kuan-Hsien
    Shen, Kuan-Hung
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2019, 61 : 272 - 283
  • [7] No-Reference Stereoscopic Image Quality Assessment
    Akhter, Roushain
    Sazzad, Z. M. Parvez
    Horita, Y.
    Baltes, J.
    STEREOSCOPIC DISPLAYS AND APPLICATIONS XXI, 2010, 7524
  • [8] Bivariate analysis of 3D structure for stereoscopic image quality assessment
    Yao, Yang
    Shen, Liquan
    An, Ping
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2018, 65 : 128 - 140
  • [9] Game theory based no-reference perceptual quality assessment for stereoscopic images
    Jiang, Feng
    Bharanitharan, K.
    Barma, Shovan
    Wang, Hailiang
    Zhao, Debin
    JOURNAL OF SUPERCOMPUTING, 2015, 71 (09) : 3337 - 3352
  • [10] Three-Stream 3D deep CNN for no-Reference stereoscopic video quality assessment
    Imani, Hassan
    Islam, Md Baharul
    Arica, Nafiz
    INTELLIGENT SYSTEMS WITH APPLICATIONS, 2022, 13