Deep multi-label learning for image distortion identification

被引:13
|
作者
Liang, Dong [1 ]
Gao, Xinbo [1 ]
Lu, Wen [1 ]
He, Lihuo [1 ]
机构
[1] Xidian Univ, Sch Elect Engn, Video & Image Proc Syst Lab, Xian 710071, Peoples R China
基金
中国国家自然科学基金;
关键词
Image distortion identification; Multi-label learning; Convolutional neural network; Multi-task learning; Deep learning; QUALITY ASSESSMENT; CLASSIFICATION;
D O I
10.1016/j.sigpro.2020.107536
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Image Distortion Identification is important for image processing system enhancement, image distortion correction and image quality assessment. Although images may suffer various number of distortions while going through different systems, most of the previous researches of image distortion identification were focus on identifying single distortion in image. In this paper, we proposed a CNN-based multi-label learning model (called MLLNet) to identify distortions for different scenarios, including images having no distortion, single distortion and multiple distortions. Concretely, we transform the multi-label classification for image distortion identification to a number of multi-class classifications and use a deep multi-task CNN model to train all associated classifiers simultaneously. For unseen image, we use the trained CNN model to predict a number of classifications at same time and fuse them to final multi-label classification. The extensive experiments demonstrate that the propose algorithm can achieve good performance on several databases. Moreover, the network architecture of the CNN model can make flexible adjustment according to the different requirements. (C) 2020 Elsevier B.V. All rights reserved.
引用
收藏
页数:14
相关论文
共 50 条
  • [31] Deep code operation network for multi-label image retrieval
    Song, Ge
    Tan, Xiaoyang
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2020, 193
  • [32] A Review on Multi-Label Learning Algorithms
    Zhang, Min-Ling
    Zhou, Zhi-Hua
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2014, 26 (08) : 1819 - 1837
  • [33] Generative Multi-Label Correlation Learning
    Wang, Lichen
    Ding, Zhengming
    Lee, Kasey
    Han, Seungju
    Han, Jae-Joon
    Choi, Changkyu
    Fu, Yun
    ACM TRANSACTIONS ON KNOWLEDGE DISCOVERY FROM DATA, 2023, 17 (02)
  • [34] Multi-label Learning via Codewords
    Sedghi, Mahlagha
    Huang, Yinjie
    Georgiopoulos, Michael
    Anagnostopoulos, Georgios
    2018 IEEE 30TH INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE (ICTAI), 2018, : 221 - 228
  • [35] The Emerging Trends of Multi-Label Learning
    Liu, Weiwei
    Wang, Haobo
    Shen, Xiaobo
    Tsang, Ivor W.
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (11) : 7955 - 7974
  • [36] Facial Action Unit Detection with Multilayer Fused Multi-Task and Multi-Label Deep Learning Network
    He, Jun
    Li, Dongliang
    Bo, Sun
    Yu, Lejun
    KSII TRANSACTIONS ON INTERNET AND INFORMATION SYSTEMS, 2019, 13 (11) : 5546 - 5559
  • [37] Unconstrained Multimodal Multi-Label Learning
    Huang, Yan
    Wang, Wei
    Wang, Liang
    IEEE TRANSACTIONS ON MULTIMEDIA, 2015, 17 (11) : 1923 - 1935
  • [38] Multi-Label Learning With Hidden Labels
    Huang, Jun
    Rui, Haowei
    Li, Guorong
    Qu, Xiwen
    Tao, Tao
    Zheng, Xiao
    IEEE ACCESS, 2020, 8 : 29667 - 29676
  • [39] Feature selection for multi-label learning with streaming label
    Liu, Jinghua
    Li, Yuwen
    Weng, Wei
    Zhang, Jia
    Chen, Baihua
    Wu, Shunxiang
    NEUROCOMPUTING, 2020, 387 : 268 - 278
  • [40] Multi-Label Learning with Global and Local Label Correlation
    Zhu, Yue
    Kwok, James T.
    Zhou, Zhi-Hua
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2018, 30 (06) : 1081 - 1094