Deep multi-label learning for image distortion identification

被引:13
|
作者
Liang, Dong [1 ]
Gao, Xinbo [1 ]
Lu, Wen [1 ]
He, Lihuo [1 ]
机构
[1] Xidian Univ, Sch Elect Engn, Video & Image Proc Syst Lab, Xian 710071, Peoples R China
基金
中国国家自然科学基金;
关键词
Image distortion identification; Multi-label learning; Convolutional neural network; Multi-task learning; Deep learning; QUALITY ASSESSMENT; CLASSIFICATION;
D O I
10.1016/j.sigpro.2020.107536
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Image Distortion Identification is important for image processing system enhancement, image distortion correction and image quality assessment. Although images may suffer various number of distortions while going through different systems, most of the previous researches of image distortion identification were focus on identifying single distortion in image. In this paper, we proposed a CNN-based multi-label learning model (called MLLNet) to identify distortions for different scenarios, including images having no distortion, single distortion and multiple distortions. Concretely, we transform the multi-label classification for image distortion identification to a number of multi-class classifications and use a deep multi-task CNN model to train all associated classifiers simultaneously. For unseen image, we use the trained CNN model to predict a number of classifications at same time and fuse them to final multi-label classification. The extensive experiments demonstrate that the propose algorithm can achieve good performance on several databases. Moreover, the network architecture of the CNN model can make flexible adjustment according to the different requirements. (C) 2020 Elsevier B.V. All rights reserved.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] Deep Multi-Instance Multi-Label Learning for Image Annotation
    Guo, Hai-Feng
    Han, Lixin
    Su, Shoubao
    Sun, Zhou-Bao
    INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2018, 32 (03)
  • [2] Multi-label Garbage Image Classification Based on Deep Learning
    Yan, Kang
    Si, Wenyu
    Hang, Jin
    Zhou, Hong
    Zhu, Quanyin
    2020 19TH INTERNATIONAL SYMPOSIUM ON DISTRIBUTED COMPUTING AND APPLICATIONS FOR BUSINESS ENGINEERING AND SCIENCE (DCABES 2020), 2020, : 150 - 153
  • [3] Multi-label learning with multi-label smoothing regularization for vehicle re-identification
    Hou, Jinhui
    Zeng, Huanqiang
    Cai, Lei
    Zhu, Jianqing
    Chen, Jing
    Ma, Kai-Kuang
    NEUROCOMPUTING, 2019, 345 : 15 - 22
  • [4] Deep hashing for multi-label image retrieval: a survey
    Josiane Rodrigues
    Marco Cristo
    Juan G. Colonna
    Artificial Intelligence Review, 2020, 53 : 5261 - 5307
  • [5] Deep hashing for multi-label image retrieval: a survey
    Rodrigues, Josiane
    Cristo, Marco
    Colonna, Juan G.
    ARTIFICIAL INTELLIGENCE REVIEW, 2020, 53 (07) : 5261 - 5307
  • [6] Mineral Identification Based on Multi-Label Image Classification
    Wu, Baokun
    Ji, Xiaohui
    He, Mingyue
    Yang, Mei
    Zhang, Zhaochong
    Chen, Yan
    Wang, Yuzhu
    Zheng, Xinqi
    MINERALS, 2022, 12 (11)
  • [7] Reconstruction Regularized Deep Metric Learning for Multi-Label Image Classification
    Li, Changsheng
    Liu, Chong
    Duan, Lixin
    Gao, Peng
    Zheng, Kai
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2020, 31 (07) : 2294 - 2303
  • [8] Multi-Label Human Activity Recognition on Image Using Deep Learning
    Nikolaev, Pavel
    PROCEEDINGS OF THE 7TH SCIENTIFIC CONFERENCE ON INFORMATION TECHNOLOGIES FOR INTELLIGENT DECISION MAKING SUPPORT (ITIDS 2019), 2019, 166 : 141 - 145
  • [9] Supervised Deep Dictionary Learning for Single Label and Multi-Label Classification
    Singhal, Vanika
    Majumdar, Angshul
    2018 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2018,
  • [10] Multi-Label Multi-Task Deep Learning for Behavioral Coding
    Gibson, James
    Atkins, David C.
    Creed, Torrey A.
    Imel, Zac
    Georgiou, Panayiotis
    Narayanan, Shrikanth
    IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2022, 13 (01) : 508 - 518