Collaborative Learning of Label Semantics and Deep Label-Specific Features for Multi-Label Classification

被引:28
作者
Hang, Jun-Yi [1 ,2 ]
Zhang, Min-Ling [1 ,2 ]
机构
[1] Southeast Univ, Sch Comp Sci & Engn, Nanjing 210096, Peoples R China
[2] Southeast Univ, Key Lab Comp Network & Informat Integrat, Minist Educ, Nanjing, Peoples R China
基金
美国国家科学基金会;
关键词
Semantics; Feature extraction; Correlation; Deep learning; Representation learning; Encoding; Collaboration; Machine learning; multi-label classification; label-specific features; label semantics; collaborative learning; SELECTION;
D O I
10.1109/TPAMI.2021.3136592
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In multi-label classification, the strategy of label-specific features has been shown to be effective to learn from multi-label examples by accounting for the distinct discriminative properties of each class label. However, most existing approaches exploit the semantic relations among labels as immutable prior knowledge, which may not be appropriate to constrain the learning process of label-specific features. In this paper, we propose to learn label semantics and label-specific features in a collaborative way. Accordingly, a deep neural network (DNN) based approach named Clif, i.e., Collaborative Learning of label semantIcs and deep label-specific Features for multi-label classification, is proposed. By integrating a graph autoencoder for encoding semantic relations in the label space and a tailored feature-disentangling module for extracting label-specific features, Clif is able to employ the learned label semantics to guide mining label-specific features and propagate label-specific discriminative properties to the learning process of the label semantics. In such a way, the learning of label semantics and label-specific features interact and facilitate with each other so that label semantics can provide more accurate guidance to label-specific feature learning. Comprehensive experiments on 14 benchmark data sets show that our approach outperforms other well-established multi-label classification algorithms.
引用
收藏
页码:9860 / 9871
页数:12
相关论文
共 76 条
[1]  
[Anonymous], 1999, AAAI WORKSH TEXT LEA
[2]  
[Anonymous], 2013, PROC 30 INT C MACH L
[3]  
Bai JW, 2020, PROCEEDINGS OF THE TWENTY-NINTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, P4313
[4]  
Bhatia Kush, 2015, Advances in Neural Information Processing Systems, V28
[5]   Learning multi-label scene classification [J].
Boutell, MR ;
Luo, JB ;
Shen, XP ;
Brown, CM .
PATTERN RECOGNITION, 2004, 37 (09) :1757-1771
[6]   Graded Multilabel Classification by Pairwise Comparisons [J].
Brinker, Christian ;
Mencia, Eneldo Loza ;
Fuernkranz, Johannes .
2014 IEEE INTERNATIONAL CONFERENCE ON DATA MINING (ICDM), 2014, :731-736
[7]  
Cabral R., 2011, ADV NEURAL INFORM PR
[8]   Exploiting New Sentiment-Based Meta-level Features for Effective Sentiment Analysis [J].
Canuto, Sergio ;
Goncalves, Marcos Andre ;
Benevenuto, Fabricio .
PROCEEDINGS OF THE NINTH ACM INTERNATIONAL CONFERENCE ON WEB SEARCH AND DATA MINING (WSDM'16), 2016, :53-62
[9]  
Charte F, 2014, LECT NOTES COMPUT SC, V8669, P1, DOI 10.1007/978-3-319-10840-7_1
[10]   A novel approach for learning label correlation with application to feature selection of multi-label data [J].
Che, Xiaoya ;
Chen, Degang ;
Mi, Jusheng .
INFORMATION SCIENCES, 2020, 512 :795-812