Towards Class-Imbalance Aware Multi-Label Learning

被引:61
作者
Zhang, Min-Ling [1 ,2 ]
Li, Yu-Kun [1 ,3 ]
Yang, Hao [1 ,2 ]
Liu, Xu-Ying [1 ,2 ]
机构
[1] Southeast Univ, Sch Comp Sci & Engn, Nanjing 210096, Peoples R China
[2] Southeast Univ, Minist Educ, Key Lab Comp Network & Informat Integrat, Nanjing, Peoples R China
[3] Baidu Inc, Business Grp Nat Language Proc, Beijing 100085, Peoples R China
基金
美国国家科学基金会;
关键词
Training; Correlation; Predictive models; Labeling; Task analysis; Couplings; Technological innovation; Class-imbalance; cross-coupling aggregation (COCOA); machine learning; multi-label learning; CLASSIFICATION; CLASSIFIERS; ENSEMBLE;
D O I
10.1109/TCYB.2020.3027509
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Multi-label learning deals with training examples each represented by a single instance while associated with multiple class labels. Due to the exponential number of possible label sets to be considered by the predictive model, it is commonly assumed that label correlations should be well exploited to design an effective multi-label learning approach. On the other hand, class-imbalance stands as an intrinsic property of multi-label data which significantly affects the generalization performance of the multi-label predictive model. For each class label, the number of training examples with positive labeling assignment is generally much less than those with negative labeling assignment. To deal with the class-imbalance issue for multi-label learning, a simple yet effective class-imbalance aware learning strategy called cross-coupling aggregation (COCOA) is proposed in this article. Specifically, COCOA works by leveraging the exploitation of label correlations as well as the exploration of class-imbalance simultaneously. For each class label, a number of multiclass imbalance learners are induced by randomly coupling with other labels, whose predictions on the unseen instance are aggregated to determine the corresponding labeling relevancy. Extensive experiments on 18 benchmark datasets clearly validate the effectiveness of COCOA against state-of-the-art multi-label learning approaches especially in terms of imbalance-specific evaluation metrics.
引用
收藏
页码:4459 / 4471
页数:13
相关论文
共 69 条
[1]   To Combat Multi-Class Imbalanced Problems by Means of Over-Sampling Techniques [J].
Abdi, Lida ;
Hashemi, Sattar .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2016, 28 (01) :238-251
[2]   Data scarcity, robustness and extreme multi-label classification [J].
Babbar, Rohit ;
Schoelkopf, Bernhard .
MACHINE LEARNING, 2019, 108 (8-9) :1329-1351
[3]   Learning multi-label scene classification [J].
Boutell, MR ;
Luo, JB ;
Shen, XP ;
Brown, CM .
PATTERN RECOGNITION, 2004, 37 (09) :1757-1771
[4]   Correlated Multi-label Classification with Incomplete Label Space and Class Imbalance [J].
Braytee, Ali ;
Liu, Wei ;
Anaissi, Ali ;
Kennedy, Paul J. .
ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY, 2019, 10 (05)
[5]   Acoustic classification of multiple simultaneous bird species: A multi-instance multi-label approach [J].
Briggs, Forrest ;
Lakshminarayanan, Balaji ;
Neal, Lawrence ;
Fern, Xiaoli Z. ;
Raich, Raviv ;
Hadley, Sarah J. K. ;
Hadley, Adam S. ;
Betts, Matthew G. .
JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 2012, 131 (06) :4640-4650
[6]   Matrix Completion for Weakly-Supervised Multi-Label Image Classification [J].
Cabral, Ricardo ;
De la Torre, Fernando ;
Costeira, Joao Paulo ;
Bernardino, Alexandre .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2015, 37 (01) :121-135
[7]   Synergy of multi-label hierarchical ensembles, data fusion, and cost-sensitive methods for gene functional inference [J].
Cesa-Bianchi, Nicolo ;
Re, Matteo ;
Valentini, Giorgio .
MACHINE LEARNING, 2012, 88 (1-2) :209-241
[8]   Dealing with difficult minority labels in imbalanced mutilabel data sets [J].
Charte, Francisco ;
Rivera, Antonio J. ;
del Jesus, Maria J. ;
Herrera, Francisco .
NEUROCOMPUTING, 2019, 326 :39-53
[9]   MLSMOTE: Approaching imbalanced multilabel learning through synthetic instance generation [J].
Charte, Francisco ;
Rivera, Antonio J. ;
del Jesus, Maria J. ;
Herrera, Francisco .
KNOWLEDGE-BASED SYSTEMS, 2015, 89 :385-397
[10]   Addressing imbalance in multilabel classification: Measures and random resampling algorithms [J].
Charte, Francisco ;
Rivera, Antonio J. ;
del Jesus, Maria J. ;
Herrera, Francisco .
NEUROCOMPUTING, 2015, 163 :3-16