Toward a Blind Deep Quality Evaluator for Stereoscopic Images Based on Monocular and Binocular Interactions

被引:68
|
作者
Shao, Feng [1 ]
Tian, Weijun [1 ]
Lin, Weisi [2 ]
Jiang, Gangyi [1 ]
Dai, Qionghai [3 ]
机构
[1] Ningbo Univ, Fac Informat Sci & Engn, Ningbo 315211, Zhejiang, Peoples R China
[2] Nanyang Technol Univ, Sch Comp Engn, Ctr Multimedia & Network Technol, Singapore 639798, Singapore
[3] Tsinghua Univ, Broadband Networks & Digital Media Lab, Beijing 100084, Peoples R China
关键词
Deep quality evaluator; blind image quality assessment; stereoscopic image; deep neural network; NATURAL SCENE STATISTICS; RECEPTIVE-FIELDS; GAIN-CONTROL; COMPRESSION; COMBINATION; PERCEPTION; NETWORK; MODELS;
D O I
10.1109/TIP.2016.2538462
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
During recent years, blind image quality assessment (BIQA) has been intensively studied with different machine learning tools. Existing BIQA metrics, however, do not design for stereoscopic images. We believe this problem can be resolved by separating 3D images and capturing the essential attributes of images via deep neural network. In this paper, we propose a blind deep quality evaluator (DQE) for stereoscopic images (denoted by 3D-DQE) based on monocular and binocular interactions. The key technical steps in the proposed 3D-DQE are to train two separate 2D deep neural networks (2D-DNNs) from 2D monocular images and cyclopean images to model the process of monocular and binocular quality predictions, and combine the measured 2D monocular and cyclopean quality scores using different weighting schemes. Experimental results on four public 3D image quality assessment databases demonstrate that in comparison with the existing methods, the devised algorithm achieves high consistent alignment with subjective assessment.
引用
收藏
页码:2059 / 2074
页数:16
相关论文
共 50 条
  • [21] SSIM-based Binocular Perceptual Model for Quality Assessment of Stereoscopic Images
    Ma, Jian
    An, Ping
    Shen, Liquan
    Li, Kai
    Yang, Jialu
    2017 IEEE VISUAL COMMUNICATIONS AND IMAGE PROCESSING (VCIP), 2017,
  • [22] Full-Reference Quality Assessment for Stereoscopic Images Based on Binocular Vision Model
    Lin, Chaoyi
    Chen, Zhibo
    Liao, Ning
    2016 30TH ANNIVERSARY OF VISUAL COMMUNICATION AND IMAGE PROCESSING (VCIP), 2016,
  • [23] No-reference perceptual quality assessment of stereoscopic images based on binocular visual characteristics
    Chen, Lei
    Zhao, Jiying
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2019, 76 : 1 - 10
  • [24] Open perceptual binocular and monocular descriptors for stereoscopic 3D images and video characterization
    Lebreton, Pierre
    Raake, Alexander
    Barkowsky, Marcus
    Le Callet, Patrick
    2015 SEVENTH INTERNATIONAL WORKSHOP ON QUALITY OF MULTIMEDIA EXPERIENCE (QOMEX), 2015,
  • [25] Monocular-binocular feature fidelity induced index for stereoscopic image quality assessment
    Shao, Feng
    Li, Kemeng
    Jiang, Gangyi
    Yu, Mei
    Yu, Changhong
    APPLIED OPTICS, 2015, 54 (33) : 9671 - 9680
  • [26] Deep network based stereoscopic image quality assessment via binocular summing and differencing
    Hu, Jinbin
    Wang, Xuejin
    Chai, Xiongli
    Shao, Feng
    Jiang, Qiuping
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2022, 82
  • [27] Effective and Efficient Blind Quality Evaluator for Contrast Distorted Images
    Yue, Guanghui
    Hou, Chunping
    Zhou, Tianwei
    Zhang, Xinfeng
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2019, 68 (08) : 2733 - 2741
  • [28] Latitude and binocular perception based blind stereoscopic omnidirectional image quality assessment for VR system
    Yang, Yingying
    Jiang, Gangyi
    Yu, Mei
    Qi, Yubin
    SIGNAL PROCESSING, 2020, 173 (173)
  • [29] UNIVERSAL BLIND IMAGE QUALITY ASSESSMENT FOR STEREOSCOPIC IMAGES
    Fezza, Sid Ahmed
    Chetouani, Aladine
    Larabi, Mohamed-Chaker
    2016 3DTV-CONFERENCE: THE TRUE VISION - CAPTURE, TRANSMISSION AND DISPLAY OF 3D VIDEO (3DTV-CON), 2016,
  • [30] NO-REFERENCE QUALITY ASSESSMENT OF STEREOSCOPIC IMAGES BASED ON BINOCULAR COMBINATION OF LOCAL FEATURES STATISTICS
    Fan, Yu
    Larabi, Mohamed-Chaker
    Cheikh, Faouzi Alaya
    Fernandez-Maloigne, Christine
    2018 25TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2018, : 3538 - 3542