Multilabel classification using heterogeneous ensemble of multi-label classifiers

被引:85
作者
Tahir, Muhammad Atif [1 ,2 ]
Kittler, Josef [1 ]
Bouridane, Ahmed [2 ]
机构
[1] Univ Surrey, Ctr Vis Speech & Signal Proc, Guildford GU2 7XH, Surrey, England
[2] Northumbria Univ, Sch Comp Engn & Informat Sci, Newcastle Upon Tyne NE2 1XE, Tyne & Wear, England
基金
英国工程与自然科学研究理事会;
关键词
Multilabel classification; Heterogeneous ensemble of multilabel classifiers; Static/dynamic weighting;
D O I
10.1016/j.patrec.2011.10.019
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Multilabel classification is a challenging research problem in which each instance may belong to more than one class. Recently, a considerable amount of research has been concerned with the development of "good" multi-label learning methods. Despite the extensive research effort, many scientific challenges posed by e.g. highly imbalanced training sets and correlation among labels remain to be addressed. The aim of this paper is to use a heterogeneous ensemble of multi-label learners to simultaneously tackle both the sample imbalance and label correlation problems. This is different from the existing work in the sense that we are proposing to combine state-of-the-art multi-label methods by ensemble techniques instead of focusing on ensemble techniques within a multi-label learner. The proposed ensemble approach (EML) is applied to six publicly available multi-label data sets from various domains including computer vision, biology and text using several evaluation criteria. We validate the advocated approach experimentally and demonstrate that it yields significant performance gains when compared with state-of-the art multi-label methods. (C) 2011 Elsevier B.V. All rights reserved.
引用
收藏
页码:513 / 523
页数:11
相关论文
共 30 条
[1]  
[Anonymous], 2004, COMBINING PATTERN CL, DOI DOI 10.1002/0471660264
[2]  
[Anonymous], 2008, ISMIR
[3]   Learning multi-label scene classification [J].
Boutell, MR ;
Luo, JB ;
Shen, XP ;
Brown, CM .
PATTERN RECOGNITION, 2004, 37 (09) :1757-1771
[4]  
Chawla N.V., 2007, P MULT CLASS SYST
[5]   Combining instance-based learning and logistic regression for multilabel classification [J].
Cheng, Weiwei ;
Huellermeier, Eyke .
MACHINE LEARNING, 2009, 76 (2-3) :211-225
[6]  
DUDANI SA, 1976, IEEE T SYST MAN CYB, V6, P327
[7]  
Elisseeff A., 2002, ADV NIPS, V14
[8]  
Fan R, 2007, STUDY THRESHOLD SELE
[9]   Multilabel classification via calibrated label ranking [J].
Fuernkranz, Johannes ;
Huellermeier, Eyke ;
Mencia, Eneldo Loza ;
Brinker, Klaus .
MACHINE LEARNING, 2008, 73 (02) :133-153
[10]  
Godbole S, 2004, LECT NOTES ARTIF INT, V3056, P22