Dual-Stream Interactive Networks for No-Reference Stereoscopic Image Quality Assessment

被引:80
作者
Zhou, Wei [1 ]
Chen, Zhibo [1 ]
Li, Weiping [1 ]
机构
[1] Univ Sci & Technol China, CAS Key Lab Technol Geospatial Informat Proc & Ap, Hefei 230027, Anhui, Peoples R China
关键词
Stereoscopic image quality assessment; dual-stream; interactive network; human vision; end-to-end prediction; DEEP NEURAL-NETWORKS; MODELS; COMBINATION;
D O I
10.1109/TIP.2019.2902831
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The goal of objective stereoscopic image quality assessment (SIQA) is to predict the human perceptual quality of stereoscopic/3D images automatically and accurately. Compared with traditional 2D image quality assessment, the quality assessment of stereoscopic images is more challenging because of complex binocular vision mechanisms and multiple quality dimensions. In this paper, inspired by the hierarchical dualstream interactive nature of the human visual system, we propose a stereoscopic image quality assessment network (StereoQA-Net) for no-reference stereoscopic image quality assessment. The proposed StereoQA-Net is an end-to-end dual-stream interactive network containing left and right view sub-networks, where the interaction of the two sub-networks exists in multiple layers. We evaluate our method on the LIVE stereoscopic image quality databases. The experimental results show that our proposed StereoQA-Net outperforms state-of-the-art algorithms on both symmetrically and asymmetrically distorted stereoscopic image pairs of various distortion types. In a more general case, the proposed StereoQA-Net can effectively predict the perceptual quality of local regions. In addition, cross-dataset experiments also demonstrate the generalization ability of our algorithm.
引用
收藏
页码:3946 / 3958
页数:13
相关论文
共 58 条
[1]  
Agrawal P., 2014, Pixels to Voxels: Modeling Visual Representation in the Human Brain
[2]   No-Reference Stereoscopic Image Quality Assessment [J].
Akhter, Roushain ;
Sazzad, Z. M. Parvez ;
Horita, Y. ;
Baltes, J. .
STEREOSCOPIC DISPLAYS AND APPLICATIONS XXI, 2010, 7524
[3]  
[Anonymous], P 3 INT C LEARNING R
[4]  
[Anonymous], VQEG
[5]  
[Anonymous], 2012, ADV MULTIMEDIA
[6]  
[Anonymous], CEREBRAL CORTEX
[7]  
[Anonymous], 2017, CORTEXNET GENERIC NE
[8]  
[Anonymous], 2018, UNREASONABLE EFFECTI
[9]  
Bengio P., 2006, Advances in Neural Information Processing Systems 19 (NIPS06), P153, DOI DOI 10.5555/2976456.2976476
[10]   Quality Assessment of Stereoscopic Images [J].
Benoit, Alexandre ;
Le Callet, Patrick ;
Campisi, Patrizio ;
Cousseau, Romain .
EURASIP JOURNAL ON IMAGE AND VIDEO PROCESSING, 2008, 2008 (1)