Towards Class-Imbalance Aware Multi-Label Learning

被引:61
作者
Zhang, Min-Ling [1 ,2 ]
Li, Yu-Kun [1 ,3 ]
Yang, Hao [1 ,2 ]
Liu, Xu-Ying [1 ,2 ]
机构
[1] Southeast Univ, Sch Comp Sci & Engn, Nanjing 210096, Peoples R China
[2] Southeast Univ, Minist Educ, Key Lab Comp Network & Informat Integrat, Nanjing, Peoples R China
[3] Baidu Inc, Business Grp Nat Language Proc, Beijing 100085, Peoples R China
基金
美国国家科学基金会;
关键词
Training; Correlation; Predictive models; Labeling; Task analysis; Couplings; Technological innovation; Class-imbalance; cross-coupling aggregation (COCOA); machine learning; multi-label learning; CLASSIFICATION; CLASSIFIERS; ENSEMBLE;
D O I
10.1109/TCYB.2020.3027509
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Multi-label learning deals with training examples each represented by a single instance while associated with multiple class labels. Due to the exponential number of possible label sets to be considered by the predictive model, it is commonly assumed that label correlations should be well exploited to design an effective multi-label learning approach. On the other hand, class-imbalance stands as an intrinsic property of multi-label data which significantly affects the generalization performance of the multi-label predictive model. For each class label, the number of training examples with positive labeling assignment is generally much less than those with negative labeling assignment. To deal with the class-imbalance issue for multi-label learning, a simple yet effective class-imbalance aware learning strategy called cross-coupling aggregation (COCOA) is proposed in this article. Specifically, COCOA works by leveraging the exploitation of label correlations as well as the exploration of class-imbalance simultaneously. For each class label, a number of multiclass imbalance learners are induced by randomly coupling with other labels, whose predictions on the unseen instance are aggregated to determine the corresponding labeling relevancy. Extensive experiments on 18 benchmark datasets clearly validate the effectiveness of COCOA against state-of-the-art multi-label learning approaches especially in terms of imbalance-specific evaluation metrics.
引用
收藏
页码:4459 / 4471
页数:13
相关论文
共 69 条
[51]   Inverse random under sampling for class imbalance problem and its application to multi-label classification [J].
Tahir, Muhammad Atif ;
Kittler, Josef ;
Yan, Fei .
PATTERN RECOGNITION, 2012, 45 (10) :3738-3750
[52]  
Tsoumakas G, 2011, J MACH LEARN RES, V12, P2411
[53]   Random k-Labelsets for Multilabel Classification [J].
Tsoumakas, Grigorios ;
Katakis, Ioannis ;
Vlahavas, Ioannis .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2011, 23 (07) :1079-1089
[54]   Hierarchical multi-label classification with SVMs: A case study in gene function prediction [J].
Vateekul, Peerapon ;
Kubat, Miroslav ;
Sarinnapakorn, Kanoksri .
INTELLIGENT DATA ANALYSIS, 2014, 18 (04) :717-738
[55]   A transductive multi-label learning approach for video concept detection [J].
Wang, Jingdong ;
Zhao, Yinghai ;
Wu, Xiuqing ;
Hua, Xian-Sheng .
PATTERN RECOGNITION, 2011, 44 (10-11) :2274-2286
[56]   Multiclass Imbalance Problems: Analysis and Potential Solutions [J].
Wang, Shuo ;
Yao, Xin .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS, 2012, 42 (04) :1119-1130
[57]  
Wei T, 2019, PROCEEDINGS OF THE TWENTY-EIGHTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, P3842
[58]   Multilabel Image Classification via Feature/Label Co-Projection [J].
Wen, Shiping ;
Liu, Weiwei ;
Yang, Yin ;
Zhou, Pan ;
Guo, Zhenyuan ;
Yan, Zheng ;
Chen, Yiran ;
Huang, Tingwen .
IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2021, 51 (11) :7250-7259
[59]  
Wu B, 2016, AAAI CONF ARTIF INTE, P2229
[60]  
Xioufis E.S., 2011, IJCAI, P1583