Stereo Image Quality Assessment Based on Top-Down Visual Mechanism

被引:0
作者
Li, Sumei [1 ]
Zhang, Huilin [1 ]
机构
[1] Tianjin Univ, Sch Elect & Informat Engn, Tianjin 300072, Peoples R China
关键词
image processing; stereo image quality assessment; human visual system; top-down; convolutional neural network;
D O I
10.3788/LOP241231
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In order to improve the consistency of metrics between the objective assessment and the human subjective evaluation of stereo image quality, inspired by the top-down mechanism of human vision, this paper proposes a stereo attention-based no-reference stereo image quality assessment method. In the proposed stereo attention module. First, the amplitude of binocular response is adaptively adjusted by the energy coefficient in the proposed binocular fusion module, and the binocular features are processed simultaneously in the spatial and channel dimensions. Second, the proposed binocular modulation module realizes the top-down modulation of the high-level binocular information to the low-level bino- and monocular information simultaneously. In addition, the dual-pooling strategy proposed in this paper processes the binocular fusion map and binocular difference map to obtain the critical information that is more conducive to quality score regression. The performance of the proposed method is validated based on the publicly available LIVE 3D and WIVC 3D databases. The experimental results show that the proposed method achieves high consistency between objective assessment indices and labels.
引用
收藏
页数:9
相关论文
共 34 条
[1]   A cortical mechanism for triggering top-down facilitation in visual object recognition [J].
Bar, M .
JOURNAL OF COGNITIVE NEUROSCIENCE, 2003, 15 (04) :600-609
[2]   GCNet: Non-local Networks Meet Squeeze-Excitation Networks and Beyond [J].
Cao, Yue ;
Xu, Jiarui ;
Lin, Stephen ;
Wei, Fangyun ;
Hu, Han .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW), 2019, :1971-1980
[3]  
Chang Y L, 2023, IEEE Transactions on Multimedia, V25, P8855
[4]   Bidirectional Feature Aggregation Network for Stereo Image Quality Assessment Considering Parallax Attention-Based Binocular Fusion [J].
Chang, Yongli ;
Li, Sumei ;
Liu, Anqi ;
Zhang, Wenlin ;
Jin, Jie ;
Xiang, Wei .
IEEE TRANSACTIONS ON BROADCASTING, 2024, 70 (01) :278-289
[5]   Measurement of Comfortable Range of Stereo Image Saturation Based on Salient Region [J].
Chang Yongli ;
Li Sumei ;
Hu Jiajie ;
Han Xu .
ACTA OPTICA SINICA, 2018, 38 (07)
[6]   Full-reference quality assessment of stereopairs accounting for rivalry [J].
Chen, Ming-Jun ;
Su, Che-Chun ;
Kwon, Do-Kyoung ;
Cormack, Lawrence K. ;
Bovik, Alan C. .
SIGNAL PROCESSING-IMAGE COMMUNICATION, 2013, 28 (09) :1143-1155
[7]   No-Reference Quality Assessment of Natural Stereopairs [J].
Chen, Ming-Jun ;
Cormack, Lawrence K. ;
Bovik, Alan C. .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2013, 22 (09) :3379-3391
[8]   Learning a No-Reference Quality Predictor of Stereoscopic Images by Visual Binocular Properties [J].
Fang, Yuming ;
Yan, Jiebin ;
Wang, Jiheng ;
Liu, Xuelin ;
Zhai, Guangtao ;
Le Callet, Patrick .
IEEE ACCESS, 2019, 7 :132649-132661
[9]   Identity Mappings in Deep Residual Networks [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
COMPUTER VISION - ECCV 2016, PT IV, 2016, 9908 :630-645
[10]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778