Ensemble methods for multi-label classification

被引:87
作者
Rokach, Lior [1 ]
Schclar, Alon [2 ]
Itach, Ehud [1 ]
机构
[1] Ben Gurion Univ Negev, Dept Informat Syst Engn, IL-84105 Beer Sheva, Israel
[2] Acad Coll Tel Aviv Yafo, Sch Comp Sci, IL-61083 Tel Aviv, Israel
关键词
Multi-label classification; Ensemble learning; APPROXIMATION ALGORITHMS;
D O I
10.1016/j.eswa.2014.06.015
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Ensemble methods have been shown to be an effective tool for solving multi-label classification tasks. In the RAndom k-labELsets (RAKEL) algorithm, each member of the ensemble is associated with a small randomly-selected subset of k labels. Then, a single label classifier is trained according to each combination of elements in the subset. In this paper we adopt a similar approach, however, instead of randomly choosing subsets, we select the minimum required subsets of k labels that cover all labels and meet additional constraints such as coverage of inter-label correlations. Construction of the cover is achieved by formulating the subset selection as a minimum set covering problem (SCP) and solving it by using approximation algorithms. Every cover needs only to be prepared once by offline algorithms. Once prepared, a cover may be applied to the classification of any given multi-label dataset whose properties conform with those of the cover. The contribution of this paper is two-fold. First, we introduce SCP as a general framework for constructing label covers while allowing the user to incorporate cover construction constraints. We demonstrate the effectiveness of this framework by proposing two construction constraints whose enforcement produces covers that improve the prediction performance of random selection by achieving better coverage of labels and inter-label correlations. Second, we provide theoretical bounds that quantify the probabilities of random selection to produce covers that meet the proposed construction criteria. The experimental results indicate that the proposed methods improve multi-label classification accuracy and stability compared to the RAKEL algorithm and to other state-of-the-art algorithms. (C) 2014 Elsevier Ltd. All rights reserved.
引用
收藏
页码:7507 / 7523
页数:17
相关论文
共 50 条
[41]   Multi-label Deepfake Classification [J].
Singh, Inder Pal ;
Mejri, Nesryne ;
Nguyen, Van Dat ;
Ghorbel, Enjie ;
Aouada, Djamila .
2023 IEEE 25TH INTERNATIONAL WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING, MMSP, 2023,
[42]   A Robust Experimental Evaluation of Automated Multi-Label Classification Methods [J].
de Sa, Alex G. C. ;
Pimenta, Cristiano G. ;
Pappa, Gisele L. ;
Freitas, Alex A. .
GECCO'20: PROCEEDINGS OF THE 2020 GENETIC AND EVOLUTIONARY COMPUTATION CONFERENCE, 2020, :175-183
[43]   An Ensemble Learning based Hierarchical Multi-label Classification Approach to Identify Impacts of Engineering Changes [J].
Pan, Yuwei ;
Stark, Rainer .
2020 IEEE 32ND INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE (ICTAI), 2020, :1260-1267
[44]   A New Ensemble Method for Multi-label Data Stream Classification in Non-stationary Environment [J].
Song, Ge ;
Ye, Yunming .
PROCEEDINGS OF THE 2014 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2014, :1776-1783
[45]   Multi-Label Classification of Fundus Images With EfficientNet [J].
Wang, Jing ;
Yang, Liu ;
Huo, Zhanqiang ;
He, Weifeng ;
Luo, Junwei .
IEEE ACCESS, 2020, 8 :212499-212508
[46]   An Ensemble-based Approach to Fast Classification of Multi-label Data Streams [J].
Kong, Xiangnan ;
Yu, Philip S. .
PROCEEDINGS OF THE 7TH INTERNATIONAL CONFERENCE ON COLLABORATIVE COMPUTING: NETWORKING, APPLICATIONS AND WORKSHARING (COLLABORATECOM), 2011, :95-104
[47]   Residual diverse ensemble for long-tailed multi-label text classification [J].
Shi, Jiangxin ;
Wei, Tong ;
Li, Yufeng .
SCIENCE CHINA-INFORMATION SCIENCES, 2024, 67 (11)
[48]   ENSEMBLE RANDOM PROJECTION FOR MULTI-LABEL CLASSIFICATION WITH APPLICATION TO PROTEIN SUBCELLULAR LOCALIZATION [J].
Wan, Shibiao ;
Mak, Man-Wai ;
Zhang, Bai ;
Wang, Yue ;
Kung, Sun-Yuan .
2014 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2014,
[49]   Calibrated Multi-label Classification with Label Correlations [J].
Zhi-Fen He ;
Ming Yang ;
Hui-Dong Liu ;
Lei Wang .
Neural Processing Letters, 2019, 50 :1361-1380
[50]   Robust label compression for multi-label classification [J].
Zhang, Ju-Jie ;
Fang, Min ;
Wu, Jin-Qiao ;
Li, Xiao .
KNOWLEDGE-BASED SYSTEMS, 2016, 107 :32-42