No-Reference Stereoscopic Image Quality Assessment Considering Multi-loss Constraints

被引:2
|
作者
Han, Yongtian [1 ]
Li, Sumei [1 ]
Yue, Guanghui [2 ]
Chang, Yongli [1 ]
机构
[1] Tianjin Univ, Sch Elect & Informat Engn, Tianjin, Peoples R China
[2] Shenzhen Univ, Sch Biomed Engn, Hlth Sci Ctr, Shenzhen, Peoples R China
来源
2020 IEEE INTERNATIONAL CONFERENCE ON VISUAL COMMUNICATIONS AND IMAGE PROCESSING (VCIP) | 2020年
关键词
stereoscopic image quality assessment; multi-loss; proxy labels; adaptive loss weights; convolutional neural network;
D O I
10.1109/vcip49819.2020.9301832
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, a three-channel convolutional neural network (CNN) constrained by multiple loss functions is designed for stereoscopic image quality assessment (SIQA). Given that both monocular and binocular information are crucial for SIQA, we take the patches of left images, right images and difference images as the inputs of the three channels respectively. Since using the ground truth as the labels of image patches cannot accurately characterize their quality, we propose to individually label each image patch to preserve the quality difference among different regions and views. Moreover, the multi-loss structure is adopted in the proposed method to consider both local features and global features simultaneously, which can constrain the feature learning from multiple perspectives. And the additional adaptive loss weights make the multi-loss network more flexible and universal. The experimental results show that the proposed method is superior to other existing SIQA methods with state-of-the-art performance.
引用
收藏
页码:334 / 337
页数:4
相关论文
共 50 条
  • [1] Stereoscopic image quality assessment considering visual mechanism and multi-loss constraints
    Li, Sumei
    Li, Yueyang
    Han, Yongtian
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2021, 79
  • [2] No-Reference Stereoscopic Image Quality Assessment Considering Binocular Disparity and Fusion Compensation
    Feng Jinhui
    Li, Sumei
    Chang, Yongli
    2021 INTERNATIONAL CONFERENCE ON VISUAL COMMUNICATIONS AND IMAGE PROCESSING (VCIP), 2021,
  • [3] Binocular Visual Mechanism Guided No-Reference Stereoscopic Image Quality Assessment Considering Spatial Saliency
    Feng, Jinhui
    Li, Sumei
    Chang, Yongli
    2021 INTERNATIONAL CONFERENCE ON VISUAL COMMUNICATIONS AND IMAGE PROCESSING (VCIP), 2021,
  • [4] No-Reference Stereoscopic Image Quality Assessment Based on Multi-Level Representation Network
    Shen L.
    Wang D.
    Xu K.
    Tianjin Daxue Xuebao (Ziran Kexue yu Gongcheng Jishu Ban)/Journal of Tianjin University Science and Technology, 2021, 54 (04): : 356 - 361
  • [5] No-reference stereoscopic image quality assessment based on cyclopean image and enhanced image
    Li, Sumei
    Ding, Yixiu
    Chang, Yongli
    SIGNAL IMAGE AND VIDEO PROCESSING, 2020, 14 (03) : 565 - 573
  • [6] No-reference stereoscopic image quality assessment based on cyclopean image and enhanced image
    Sumei Li
    Yixiu Ding
    Yongli Chang
    Signal, Image and Video Processing, 2020, 14 : 565 - 573
  • [7] No-Reference Stereoscopic Image Quality Assessment Guided by a Disparity Map
    Li S.
    Ding Y.
    Chang Y.
    Han X.
    Tianjin Daxue Xuebao (Ziran Kexue yu Gongcheng Jishu Ban)/Journal of Tianjin University Science and Technology, 2020, 53 (08): : 854 - 860
  • [8] NO-REFERENCE STEREOSCOPIC IMAGE QUALITY ASSESSMENT BASED ON LOCAL TO GLOBAL FEATURE REGRESSION
    Li, Sumei
    Xue, Jianwei
    Han, Yongtian
    2019 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2019, : 448 - 453
  • [9] No-Reference Stereoscopic Image Quality Assessment Based on Singular Value Decomposition
    Shen L.
    Wang Y.
    Tianjin Daxue Xuebao (Ziran Kexue yu Gongcheng Jishu Ban)/Journal of Tianjin University Science and Technology, 2020, 53 (06): : 641 - 646
  • [10] No-Reference Stereoscopic Image Quality Assessment Based on Visual Attention and Perception
    Li, Yafei
    Yang, Feng
    Wan, Wenbo
    Wang, Jun
    Gao, Min
    Zhang, Jia
    Sun, Jiande
    IEEE ACCESS, 2019, 7 : 46706 - 46716