Better multiclass classification via a margin-optimized single binary problem

被引:8
作者
El-Yaniv, Ran [1 ]
Pechyony, Dmitry [1 ]
Yom-Tov, Elad [2 ]
机构
[1] Technion Israel Inst Technol, Dept Comp Sci, IL-32000 Haifa, Israel
[2] IBM Haifa Res Lab, IL-31905 Haifa, Israel
关键词
multiclass classification; support vector machines; multiple kernel learning;
D O I
10.1016/j.patrec.2008.06.012
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We develop a new multiclass classification method that reduces the multiclass problem to a single binary classifier (SBC). Our method constructs the binary problem by embedding smaller binary problems into a single space. A good embedding will allow for large margin classification. We show that the construction Of Such an embedding can be reduced to the task of learning linear combinations of kernels. We provide a bound on the generalization error of the multiclass classifier obtained with our construction and outline the conditions for its consistency. Our empirical examination of the new method indicates that it outperforms one-vs-all, all-pairs and the error-correcting output coding scheme at least when the number of classes is small. (c) 2008 Elsevier B.V. All rights reserved.
引用
收藏
页码:1954 / 1959
页数:6
相关论文
共 26 条
[21]   Learning bounds for support vector machines with learned kernels [J].
Srebro, Nathan ;
Ben-David, Shai .
LEARNING THEORY, PROCEEDINGS, 2006, 4005 :169-183
[22]  
TSANG I, 2005, JMLR, V5, P363
[23]  
Tsochantaridis I, 2005, J MACH LEARN RES, V6, P1453
[24]  
Vapnik V., 1998, STAT LEARNING THEORY, V1, P2
[25]  
ZHANG T, 2004, JMLR
[26]  
ZIEN A, 2007, ICM