Teacher-Guided Learning for Blind Image Quality Assessment

被引:0
作者
Chen, Zewen [1 ,2 ]
Wang, Juan [1 ]
Li, Bing [1 ]
Yuan, Chunfeng [1 ]
Xiong, Weihua [4 ]
Cheng, Rui [4 ]
Hu, Weiming [1 ,2 ,3 ]
机构
[1] Chinese Acad Sci, Inst Automat, NLPR, Beijing, Peoples R China
[2] Univ Chinese Acad Sci, Sch Artificial Intelligence, Beijing, Peoples R China
[3] CAS Ctr Excellence Brain Sci & Intelligence Techn, Shanghai, Peoples R China
[4] Zeku Technol Shanghai Corp, Shanghai, Peoples R China
来源
COMPUTER VISION - ACCV 2022, PT III | 2023年 / 13843卷
关键词
Blind image quality assessment; Image restoration; Prior knowledge; STATISTICS;
D O I
10.1007/978-3-031-26313-2_13
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The performance of deep learning models for blind image quality assessment (BIQA) suffers from annotated data insufficiency. However, image restoration, as a closely-related task with BIQA, can easily acquire training data without annotation. Moreover, both image semantic and distortion information are vital knowledge for the two tasks to predict and improve image quality. Inspired by these, this paper proposes a novel BIQA framework, which builds an image restoration model as a teacher network (TN) to learn the two aspects of knowledge and then guides the student network (SN) for BIQA. In TN, multi-branch convolutions are leveraged for performing adaptive restoration from diversely distorted images to strengthen the knowledge learning. Then the knowledge is transferred to the SN and progressively aggregated by computing long-distance responses to improve BIQA on small annotated data. Experimental results show that our method outperforms many state-of-the-arts on both synthetic and authentic datasets. Besides, the generalization, robustness and effectiveness of our method are fully validated. The code is available in https://github.com/chencn2020/TeacherIQA.
引用
收藏
页码:206 / 222
页数:17
相关论文
共 54 条
  • [1] On the use of deep learning for blind image quality assessment
    Bianco, Simone
    Celona, Luigi
    Napoletano, Paolo
    Schettini, Raimondo
    [J]. SIGNAL IMAGE AND VIDEO PROCESSING, 2018, 12 (02) : 355 - 362
  • [2] Deep Neural Networks for No-Reference and Full-Reference Image Quality Assessment
    Bosse, Sebastian
    Maniry, Dominique
    Mueller, Klaus-Robert
    Wiegand, Thomas
    Samek, Wojciech
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (01) : 206 - 219
  • [3] Chapelle O., 2009, Semi-supervised Learning, V20, P542
  • [4] Deng J, 2009, PROC CVPR IEEE, P248, DOI 10.1109/CVPRW.2009.5206848
  • [5] Perceptual Quality Assessment of Smartphone Photography
    Fang, Yuming
    Zhu, Hanwei
    Zeng, Yan
    Ma, Kede
    Wang, Zhou
    [J]. 2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 3674 - 3683
  • [6] Perceptual quality prediction on authentically distorted images using a bag of features approach
    Ghadiyaram, Deepti
    Bovik, Alan C.
    [J]. JOURNAL OF VISION, 2017, 17 (01):
  • [7] Massive Online Crowdsourced Study of Subjective and Objective Picture Quality
    Ghadiyaram, Deepti
    Bovik, Alan C.
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2016, 25 (01) : 372 - 387
  • [8] Gidaris S, 2018, Arxiv, DOI arXiv:1803.07728
  • [9] Hancheng Zhu, 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Proceedings, P14131, DOI 10.1109/CVPR42600.2020.01415
  • [10] Rethinking ImageNet Pre-training
    He, Kaiming
    Girshick, Ross
    Dollar, Piotr
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 4917 - 4926