No-Reference Stereoscopic Image Quality Assessment Considering Multi-loss Constraints

被引:2
|
作者
Han, Yongtian [1 ]
Li, Sumei [1 ]
Yue, Guanghui [2 ]
Chang, Yongli [1 ]
机构
[1] Tianjin Univ, Sch Elect & Informat Engn, Tianjin, Peoples R China
[2] Shenzhen Univ, Sch Biomed Engn, Hlth Sci Ctr, Shenzhen, Peoples R China
来源
2020 IEEE INTERNATIONAL CONFERENCE ON VISUAL COMMUNICATIONS AND IMAGE PROCESSING (VCIP) | 2020年
关键词
stereoscopic image quality assessment; multi-loss; proxy labels; adaptive loss weights; convolutional neural network;
D O I
10.1109/vcip49819.2020.9301832
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, a three-channel convolutional neural network (CNN) constrained by multiple loss functions is designed for stereoscopic image quality assessment (SIQA). Given that both monocular and binocular information are crucial for SIQA, we take the patches of left images, right images and difference images as the inputs of the three channels respectively. Since using the ground truth as the labels of image patches cannot accurately characterize their quality, we propose to individually label each image patch to preserve the quality difference among different regions and views. Moreover, the multi-loss structure is adopted in the proposed method to consider both local features and global features simultaneously, which can constrain the feature learning from multiple perspectives. And the additional adaptive loss weights make the multi-loss network more flexible and universal. The experimental results show that the proposed method is superior to other existing SIQA methods with state-of-the-art performance.
引用
收藏
页码:334 / 337
页数:4
相关论文
共 50 条
  • [21] No-reference Stereoscopic Image Quality Assessment Using Binocular Self-similarity and Deep Neural Network
    Lv, Yaqi
    Yu, Mei
    Jiang, Gangyi
    Shao, Feng
    Peng, Zongju
    Chen, Fen
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2016, 47 : 346 - 357
  • [22] No-Reference Stereo Image Quality Assessment Based on Image Fusion
    Huang Shuyu
    Sang Qingbing
    LASER & OPTOELECTRONICS PROGRESS, 2019, 56 (07)
  • [23] CNN Based No-Reference HDR Image Quality Assessment
    Kefeng, Fan
    Jiyun, Liang
    Fei, Li
    Puye, Qiu
    CHINESE JOURNAL OF ELECTRONICS, 2021, 30 (02) : 282 - 288
  • [24] ACTIVE INFERENCE OF GAN FOR NO-REFERENCE IMAGE QUALITY ASSESSMENT
    Ma, Jupo
    Wu, Jinjian
    Li, Leida
    Dong, Weisheng
    Xie, Xuemei
    2020 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2020,
  • [25] Exploiting Neural Models for No-reference Image Quality Assessment
    Pan, Cenhui
    Xu, Yi
    Yan, Yichao
    Gu, Ke
    Yang, Xiaokang
    2016 30TH ANNIVERSARY OF VISUAL COMMUNICATION AND IMAGE PROCESSING (VCIP), 2016,
  • [26] No-reference image quality assessment based on hybrid model
    Li, Jie
    Yan, Jia
    Deng, Dexiang
    Shi, Wenxuan
    Deng, Songfeng
    SIGNAL IMAGE AND VIDEO PROCESSING, 2017, 11 (06) : 985 - 992
  • [27] No-reference image quality assessment based on hybrid model
    Jie Li
    Jia Yan
    Dexiang Deng
    Wenxuan Shi
    Songfeng Deng
    Signal, Image and Video Processing, 2017, 11 : 985 - 992
  • [28] Objective Reduced reference Stereoscopic image quality assessment
    Touzouti, N.
    Serir, A.
    2019 INTERNATIONAL CONFERENCE ON ADVANCED ELECTRICAL ENGINEERING (ICAEE), 2019,
  • [29] No-reference screen content image quality assessment based on multi-region features
    Xuhao Jiang
    Liquan Shen
    Liangwei Yu
    Mingxing Jiang
    Guorui Feng
    NEUROCOMPUTING, 2020, 386 : 30 - 41
  • [30] No-reference Distorted Image Quality Assessment Based on Deep Learning
    Guo, Chang
    Liu, Haoting
    Pan, Shunliang
    Dong, Weidong
    Yang, Shuo
    Tian, Guoliang
    PROCEEDINGS OF 2018 IEEE 4TH INFORMATION TECHNOLOGY AND MECHATRONICS ENGINEERING CONFERENCE (ITOEC 2018), 2018, : 586 - 591