No-Reference Stereoscopic Image Quality Assessment Considering Multi-loss Constraints

被引:2
|
作者
Han, Yongtian [1 ]
Li, Sumei [1 ]
Yue, Guanghui [2 ]
Chang, Yongli [1 ]
机构
[1] Tianjin Univ, Sch Elect & Informat Engn, Tianjin, Peoples R China
[2] Shenzhen Univ, Sch Biomed Engn, Hlth Sci Ctr, Shenzhen, Peoples R China
来源
2020 IEEE INTERNATIONAL CONFERENCE ON VISUAL COMMUNICATIONS AND IMAGE PROCESSING (VCIP) | 2020年
关键词
stereoscopic image quality assessment; multi-loss; proxy labels; adaptive loss weights; convolutional neural network;
D O I
10.1109/vcip49819.2020.9301832
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, a three-channel convolutional neural network (CNN) constrained by multiple loss functions is designed for stereoscopic image quality assessment (SIQA). Given that both monocular and binocular information are crucial for SIQA, we take the patches of left images, right images and difference images as the inputs of the three channels respectively. Since using the ground truth as the labels of image patches cannot accurately characterize their quality, we propose to individually label each image patch to preserve the quality difference among different regions and views. Moreover, the multi-loss structure is adopted in the proposed method to consider both local features and global features simultaneously, which can constrain the feature learning from multiple perspectives. And the additional adaptive loss weights make the multi-loss network more flexible and universal. The experimental results show that the proposed method is superior to other existing SIQA methods with state-of-the-art performance.
引用
收藏
页码:334 / 337
页数:4
相关论文
共 50 条
  • [41] No-reference synthetic image quality assessment with convolutional neural network and local image saliency
    Xiaochuan Wang
    Xiaohui Liang
    Bailin Yang
    Frederick W.B.Li
    ComputationalVisualMedia, 2019, 5 (02) : 193 - 208
  • [42] Multi-pooled Inception Features for No-reference Video Quality Assessment
    Varga, Domonkos
    VISAPP: PROCEEDINGS OF THE 15TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS, VOL 4: VISAPP, 2020, : 338 - 347
  • [43] No-reference synthetic image quality assessment with convolutional neural network and local image saliency
    Wang, Xiaochuan
    Liang, Xiaohui
    Yang, Bailin
    Li, Frederick W. B.
    COMPUTATIONAL VISUAL MEDIA, 2019, 5 (02) : 193 - 208
  • [44] A No-Reference and Full-Reference image quality assessment and enhancement framework in real-time
    Zahi Al Chami
    Chady Abou Jaoude
    Richard Chbeir
    Mahmoud Barhamgi
    Mansour Naser Alraja
    Multimedia Tools and Applications, 2022, 81 : 32491 - 32517
  • [45] A No-Reference and Full-Reference image quality assessment and enhancement framework in real-time
    Al Chami, Zahi
    Abou Jaoude, Chady
    Chbeir, Richard
    Barhamgi, Mahmoud
    Alraja, Mansour Naser
    MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (22) : 32491 - 32517
  • [46] Multiscale convolutional neural network for no-reference image quality assessment with saliency detection
    Fan, Xiaodong
    Wang, Yang
    Wang, Changzhong
    Chen, Xiangyue
    MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (29) : 42607 - 42619
  • [47] Multiscale convolutional neural network for no-reference image quality assessment with saliency detection
    Xiaodong Fan
    Yang Wang
    Changzhong Wang
    Xiangyue Chen
    Multimedia Tools and Applications, 2022, 81 : 42607 - 42619
  • [48] REDUCED REFERENCE STEREOSCOPIC IMAGE QUALITY ASSESSMENT BASED ON ENTROPY OF CLASSIFIED PRIMITIVES
    Wan, Zhaolin
    Qi, Feng
    Liu, Yutao
    Zhao, Debin
    2017 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2017, : 73 - 78
  • [49] An Efficient Method for No-Reference Video Quality Assessment
    Agarla, Mirko
    Celona, Luigi
    Schettini, Raimondo
    JOURNAL OF IMAGING, 2021, 7 (03)
  • [50] No-reference image quality assessment based on dual-channel convolutional neural network
    Huang, Shuyu
    Sang, Qingbing
    Wu, Qin
    Wu, Xiaojun
    Li, Chaofeng
    2018 INTERNATIONAL SYMPOSIUM IN SENSING AND INSTRUMENTATION IN IOT ERA (ISSI), 2018,