No-reference Stereoscopic Image Quality Assessment Based on Parallel Multi-scale Perception

被引:0
作者
Zhang, Ziyi [1 ]
Li, Sumei [1 ]
机构
[1] Tianjin Univ, Sch Elect & Informat Engn, Tianjin, Peoples R China
来源
2022 IEEE INTERNATIONAL CONFERENCE ON VISUAL COMMUNICATIONS AND IMAGE PROCESSING (VCIP) | 2022年
关键词
no-reference stereoscopic image quality assessment (NR-SIQA); convolution neural network (CNN); human visual system (HVS);
D O I
10.1109/VCIP56404.2022.10008875
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
With the rapid development of 3D technologies, effective no-reference stereoscopic image quality assessment (NR-SIQA) methods are in great demand. In this paper, we propose a parallel multi-scale feature extraction convolution neural network (CNN) model combined with novel binocular feature interaction consistent with human visual system (HVS). In order to simulate the characteristics of HVS sensing multi-scale information at the same time, parallel multi-scale feature extraction module (PMSFM) followed by compensation information is proposed. And modified convolutional block attention module (MCBAM) with less computational complexity is designed to generate visual attention maps for the multi-scale features extracted by the PMSFM. In addition, we employ cross-stacked strategy for multi-level binocular fusion maps and binocular disparity maps to simulate the hierarchical perception characteristics of HVS. Experimental results show that our method is superior to the state-of-the-art metrics and achieves an excellent performance.
引用
收藏
页数:5
相关论文
共 19 条
  • [1] A MULTI-TASK CONVOLUTIONAL NEURAL NETWORK FOR BLIND STEREOSCOPIC IMAGE QUALITY ASSESSMENT USING NATURALNESS ANALYSIS
    Bourbia, Salima
    Karine, Ayoub
    Chetouani, Aladine
    El Hassoun, Mohammed
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2021, : 1434 - 1438
  • [2] Maps in the brain: What can we learn from them?
    Chklovskii, DB
    Koulakov, AA
    [J]. ANNUAL REVIEW OF NEUROSCIENCE, 2004, 27 : 369 - 392
  • [3] Stereoscopic image quality assessment by deep convolutional neural network
    Fang, Yuming
    Yan, Jiebin
    Liu, Xuelin
    Wang, Jiheng
    [J]. JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2019, 58 : 400 - 406
  • [4] Using fair AI to predict students' math learning outcomes in an online platform
    Li, Chenglu
    Xing, Wanli
    Leite, Walter
    [J]. INTERACTIVE LEARNING ENVIRONMENTS, 2024, 32 (03) : 1117 - 1136
  • [5] Li S., 2019, 2019 IEEE INT C MULT
  • [6] Peichl L., 2009, RETINAL GANGLION CEL
  • [7] A quantitative theory of immediate visual recognition
    Serre, Thomas
    Kreiman, Gabriel
    Kouh, Minjoon
    Cadieu, Charles
    Knoblich, Ulf
    Poggio, Tomaso
    [J]. COMPUTATIONAL NEUROSCIENCE: THEORETICAL INSIGHTS INTO BRAIN FUNCTION, 2007, 165 : 33 - 56
  • [8] Shen L., 2020, NEW ENGL J MED, V424
  • [9] Blind Stereoscopic Image Quality Evaluator Based on Binocular Semantic and Quality Channels
    Sim, Kyohoon
    Yang, Jiachen
    Lu, Wen
    Gao, Xinbo
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2022, 24 : 1389 - 1398
  • [10] Representative Task Self-Selection for Flexible Clustered Lifelong Learning
    Sun, Gan
    Cong, Yang
    Wang, Qianqian
    Zhong, Bineng
    Fu, Yun
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (04) : 1467 - 1481