Toward a Blind Deep Quality Evaluator for Stereoscopic Images Based on Monocular and Binocular Interactions

被引:68
|
作者
Shao, Feng [1 ]
Tian, Weijun [1 ]
Lin, Weisi [2 ]
Jiang, Gangyi [1 ]
Dai, Qionghai [3 ]
机构
[1] Ningbo Univ, Fac Informat Sci & Engn, Ningbo 315211, Zhejiang, Peoples R China
[2] Nanyang Technol Univ, Sch Comp Engn, Ctr Multimedia & Network Technol, Singapore 639798, Singapore
[3] Tsinghua Univ, Broadband Networks & Digital Media Lab, Beijing 100084, Peoples R China
关键词
Deep quality evaluator; blind image quality assessment; stereoscopic image; deep neural network; NATURAL SCENE STATISTICS; RECEPTIVE-FIELDS; GAIN-CONTROL; COMPRESSION; COMBINATION; PERCEPTION; NETWORK; MODELS;
D O I
10.1109/TIP.2016.2538462
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
During recent years, blind image quality assessment (BIQA) has been intensively studied with different machine learning tools. Existing BIQA metrics, however, do not design for stereoscopic images. We believe this problem can be resolved by separating 3D images and capturing the essential attributes of images via deep neural network. In this paper, we propose a blind deep quality evaluator (DQE) for stereoscopic images (denoted by 3D-DQE) based on monocular and binocular interactions. The key technical steps in the proposed 3D-DQE are to train two separate 2D deep neural networks (2D-DNNs) from 2D monocular images and cyclopean images to model the process of monocular and binocular quality predictions, and combine the measured 2D monocular and cyclopean quality scores using different weighting schemes. Experimental results on four public 3D image quality assessment databases demonstrate that in comparison with the existing methods, the devised algorithm achieves high consistent alignment with subjective assessment.
引用
收藏
页码:2059 / 2074
页数:16
相关论文
共 50 条
  • [41] Stereoscopic Image Quality Assessment Based on Binocular Adding and Subtracting
    Yang, Jiachen
    Jiang, Bin
    Ji, Chunqi
    Zhu, Yinghao
    Lu, Wen
    COMPUTER VISION, PT II, 2017, 772 : 237 - 247
  • [42] Binocular Rivalry Oriented Predictive Autoencoding Network for Blind Stereoscopic Image Quality Measurement
    Xu, Jiahua
    Zhou, Wei
    Chen, Zhibo
    Ling, Suiyi
    Le Callet, Patrick
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2021, 70 (70)
  • [43] Registration-based distortion and binocular representation for blind quality assessment of multiply-distorted stereoscopic image
    Shi, Yiqing
    Guo, Wenzhong
    Niu, Yuzhen
    Wu, Yi
    COMMUNICATIONS IN INFORMATION AND SYSTEMS, 2023, 23 (04) : 423 - 445
  • [44] Toward a Universal Learning-Based Image Quality Metric with Reference for Stereoscopic Images
    Chetouani, Aladine
    2016 IEEE/ACS 13TH INTERNATIONAL CONFERENCE OF COMPUTER SYSTEMS AND APPLICATIONS (AICCSA), 2016,
  • [45] Learning Receptive Fields and Quality Lookups for Blind Quality Assessment of Stereoscopic Images
    Shao, Feng
    Lin, Weisi
    Wang, Shanshan
    Jiang, Gangyi
    Yu, Mei
    Dai, Qionghai
    IEEE TRANSACTIONS ON CYBERNETICS, 2016, 46 (03) : 730 - 743
  • [46] Blind assessment for stereo images considering binocular characteristics and deep perception map based on deep belief network
    Yang, Jiachen
    Zhao, Yang
    Zhu, Yinghao
    Xu, Huifang
    Lu, Wen
    Meng, Qinggang
    INFORMATION SCIENCES, 2019, 474 : 1 - 17
  • [47] A Multi-Attribute Blind Quality Evaluator for Tone-Mapped Images
    Mahmoudpour, Saeed
    Schelkens, Peter
    IEEE TRANSACTIONS ON MULTIMEDIA, 2020, 22 (08) : 1939 - 1954
  • [48] A Blind Stereoscopic Image Quality Evaluator With Segmented Stacked Autoencoders Considering the Whole Visual Perception Route
    Yang, Jiachen
    Sim, Kyohoon
    Gao, Xinbo
    Lu, Wen
    Meng, Qinggang
    Li, Baihua
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (03) : 1314 - 1328
  • [49] Full-reference quality assessment of stereoscopic images by learning binocular visual properties
    Ma, Jian
    An, Ping
    Shen, Liquan
    Li, Kai
    APPLIED OPTICS, 2017, 56 (29) : 8291 - 8302
  • [50] No-reference quality assessment for stereoscopic images considering visual discomfort and binocular rivalry
    Ding, Yong
    Zhao, Yang
    ELECTRONICS LETTERS, 2017, 53 (25) : 1646 - 1647