A subspace approach to error correcting output codes

被引:29
作者
Bagheri, Mohammad Ali [1 ,2 ]
Montazer, Gholam Ali [1 ]
Kabir, Ehsanollah [3 ]
机构
[1] Tarbiat Modares Univ, Sch Engn, Dept Informat Technol, Tehran, Iran
[2] Dalhousie Univ, Fac Comp Sci, Halifax, NS, Canada
[3] Tarbiat Modares Univ, Dept Elect & Comp Engn, Tehran, Iran
关键词
Error correcting output codes; Multiclass classification; Feature subspace; Ensemble classification; MULTICLASS; CLASSIFICATION; BINARY;
D O I
10.1016/j.patrec.2012.09.010
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Among the proposed methods to deal with multi-class classification problems, the error-correcting output codes (ECOCs) represents a powerful framework. A key factor in designing any ECOC matrix is the independency of the binary classifiers, without which the ECOC method would be ineffective. This paper proposes an efficient new approach to the classical ECOC design in order to improve independency among classifiers. The main idea of the proposed method is based on using different feature subsets for each binary classifier, named subspace ECOC. In addition to creating more independent classifiers in the proposed technique, ECOC matrices with longer codes can be built. The numerical experiments in this study compare the classification accuracy of subspace ECOC, classical ECOC, one-versus-one, and one-versus-all methods over a set of UCI machine learning repository datasets and two image vision applications. The results show that the proposed technique increases the classification accuracy in comparison with the state of the art coding methods. (C) 2012 Elsevier B.V. All rights reserved.
引用
收藏
页码:176 / 184
页数:9
相关论文
共 29 条
[1]   Reducing multiclass to binary: A unifying approach for margin classifiers [J].
Allwein, EL ;
Schapire, RE ;
Singer, Y .
JOURNAL OF MACHINE LEARNING RESEARCH, 2001, 1 (02) :113-141
[2]   EFFICIENT CLASSIFICATION FOR MULTICLASS PROBLEMS USING MODULAR NEURAL NETWORKS [J].
ANAND, R ;
MEHROTRA, K ;
MOHAN, CK ;
RANKA, S .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 1995, 6 (01) :117-124
[3]  
Blake C. L., 1998, Uci repository of machine learning databases
[4]   LIBSVM: A Library for Support Vector Machines [J].
Chang, Chih-Chung ;
Lin, Chih-Jen .
ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY, 2011, 2 (03)
[5]  
Clark P, 1991, P 5 EUR WORK SESS LE, P151, DOI DOI 10.1007/BFB0017011
[6]   Support vector machine-based image classification for genetic syndrome diagnosis [J].
David, A ;
Lerner, B .
PATTERN RECOGNITION LETTERS, 2005, 26 (08) :1029-1038
[7]  
Dietterich T. G., 1995, Journal of Artificial Intelligence Research, V2, P263
[8]   Re-coding ECOCs without re-training [J].
Escalera, Sergio ;
Pujol, Oriol ;
Radeva, Petia .
PATTERN RECOGNITION LETTERS, 2010, 31 (07) :555-562
[9]   Blurred Shape Model for binary and grey-level symbol recognition [J].
Escalera, Sergio ;
Fornes, Alicia ;
Pujol, Oriol ;
Radeva, Petia ;
Sanchez, Gemma ;
Llados, Josep .
PATTERN RECOGNITION LETTERS, 2009, 30 (15) :1424-1433
[10]   Separability of ternary codes for sparse designs of error-correcting output codes [J].
Escalera, Sergio ;
Pujol, Oriol ;
Radeva, Petia .
PATTERN RECOGNITION LETTERS, 2009, 30 (03) :285-297