MULTI-LABEL CLASSIFICATION USING ERROR CORRECTING OUTPUT CODES

被引:19
作者
Kajdanowicz, Tomasz [1 ]
Kazienko, Przemyslaw [1 ]
机构
[1] Wroclaw Univ Technol, PL-50370 Wroclaw, Poland
关键词
machine learning; supervised learning; multi-label classification; error-correcting output codes; ECOC; ensemble methods; binary relevance; framework; PREDICTION;
D O I
10.2478/v10006-012-0061-2
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
A framework for multi-label classification extended by Error Correcting Output Codes (ECOCs) is introduced and empirically examined in the article. The solution assumes the base multi-label classifiers to be a noisy channel and applies ECOCs in order to recover the classification errors made by individual classifiers. The framework was examined through exhaustive studies over combinations of three distinct classification algorithms and four ECOC methods employed in the multi-label classification problem. The experimental results revealed that (i) the Bode-Chaudhuri-Hocquenghem (BCH) code matched with any multi-label classifier results in better classification quality; (ii) the accuracy of the binary relevance classification method strongly depends on the coding scheme; (iii) the label power-set and the RAkEL classifier consume the same time for computation irrespective of the coding utilized; (iv) in general, they are not suitable for ECOCs because they are not capable to benefit from ECOC correcting abilities; (v) the all-pairs code combined with binary relevance is not suitable for datasets with larger label sets.
引用
收藏
页码:829 / 840
页数:12
相关论文
共 31 条
[1]  
[Anonymous], P 2008 IEEE INT JOIN
[2]  
[Anonymous], 2011, Proceedings of the Fourteenth International Conference on Artificial Intelligence and Statistics
[3]  
[Anonymous], 2011, ENCY MACHINE LEARNIN
[4]  
[Anonymous], 2008, ISMIR
[5]  
[Anonymous], 2003, LECT NOTES COMPUTER
[6]   Learning multi-label scene classification [J].
Boutell, MR ;
Luo, JB ;
Shen, XP ;
Brown, CM .
PATTERN RECOGNITION, 2004, 37 (09) :1757-1771
[7]  
Clare A., 2001, Lecture Notes in Computer Science, P42
[8]   A family of additive online algorithms for category ranking [J].
Crammer, K ;
Singer, Y .
JOURNAL OF MACHINE LEARNING RESEARCH, 2003, 3 (06) :1025-1058
[9]  
Dietterich T. G., 1995, Journal of Artificial Intelligence Research, V2, P263
[10]  
Diplaris S, 2005, LECT NOTES COMPUT SC, V3746, P448