No-Reference Stereoscopic Image Quality Assessment Considering Multi-loss Constraints

被引:2
|
作者
Han, Yongtian [1 ]
Li, Sumei [1 ]
Yue, Guanghui [2 ]
Chang, Yongli [1 ]
机构
[1] Tianjin Univ, Sch Elect & Informat Engn, Tianjin, Peoples R China
[2] Shenzhen Univ, Sch Biomed Engn, Hlth Sci Ctr, Shenzhen, Peoples R China
来源
2020 IEEE INTERNATIONAL CONFERENCE ON VISUAL COMMUNICATIONS AND IMAGE PROCESSING (VCIP) | 2020年
关键词
stereoscopic image quality assessment; multi-loss; proxy labels; adaptive loss weights; convolutional neural network;
D O I
10.1109/vcip49819.2020.9301832
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, a three-channel convolutional neural network (CNN) constrained by multiple loss functions is designed for stereoscopic image quality assessment (SIQA). Given that both monocular and binocular information are crucial for SIQA, we take the patches of left images, right images and difference images as the inputs of the three channels respectively. Since using the ground truth as the labels of image patches cannot accurately characterize their quality, we propose to individually label each image patch to preserve the quality difference among different regions and views. Moreover, the multi-loss structure is adopted in the proposed method to consider both local features and global features simultaneously, which can constrain the feature learning from multiple perspectives. And the additional adaptive loss weights make the multi-loss network more flexible and universal. The experimental results show that the proposed method is superior to other existing SIQA methods with state-of-the-art performance.
引用
收藏
页码:334 / 337
页数:4
相关论文
共 50 条
  • [31] Combining CNN and transformers for full-reference and no-reference image quality assessment
    Zeng, Chao
    Kwong, Sam
    NEUROCOMPUTING, 2023, 549
  • [32] Deep supervised dictionary learning for no-reference image quality assessment
    Huang, Yuge
    Liu, Xuesong
    Tian, Xiang
    Zhou, Fan
    Chen, Yaowu
    Jiang, Rongxin
    JOURNAL OF ELECTRONIC IMAGING, 2018, 27 (02)
  • [33] Quality-distinguishing and patch-comparing no-reference image quality assessment
    Tao Xiang
    Hongfei Xiao
    Xue Qin
    Multimedia Tools and Applications, 2021, 80 : 19601 - 19624
  • [34] Quality-distinguishing and patch-comparing no-reference image quality assessment
    Xiang, Tao
    Xiao, Hongfei
    Qin, Xue
    MULTIMEDIA TOOLS AND APPLICATIONS, 2021, 80 (13) : 19601 - 19624
  • [35] No-Reference Image Quality Assessment Based on Statistics of Convolution Feature Maps
    Lv, Xiaoxin
    Qin, Min
    Chen, Xiaohui
    Wei, Guo
    ADVANCES IN MATERIALS, MACHINERY, ELECTRONICS II, 2018, 1955
  • [36] No-Reference Image Quality Assessment with Convolutional Neural Networks and Decision Fusion
    Varga, Domonkos
    APPLIED SCIENCES-BASEL, 2022, 12 (01):
  • [37] No-Reference Screen Content Image Quality Assessment Based on Edge Assistance and Multi-Scale Transformer
    Chen, Yu-Zhong
    Chen, You-Kun
    Lin, Min-Hu
    Niu, Yu-Zhen
    Tien Tzu Hsueh Pao/Acta Electronica Sinica, 2024, 52 (07): : 2242 - 2256
  • [38] Convolutional Neural Network with Uncertainty Estimates for No-reference Image Quality Assessment
    Huang, Yuge
    Tian, Xiang
    Jiang, Rongxin
    Chen, Yaowu
    TENTH INTERNATIONAL CONFERENCE ON GRAPHICS AND IMAGE PROCESSING (ICGIP 2018), 2019, 11069
  • [39] A Novel No-Reference Quality Assessment Metric for Stereoscopic Images with Consideration of Comprehensive 3D Quality Information
    Shen, Liquan
    Yao, Yang
    Geng, Xianqiu
    Fang, Ruigang
    Wu, Dapeng
    SENSORS, 2023, 23 (13)
  • [40] No-reference synthetic image quality assessment with convolutional neural network and local image saliency
    Xiaochuan Wang
    Xiaohui Liang
    Bailin Yang
    Frederick W. B. Li
    Computational Visual Media, 2019, 5 : 193 - 208