On the Decoding Process in Ternary Error-Correcting Output Codes

被引:183
作者
Escalera, Sergio [1 ,2 ]
Pujol, Oriol [1 ,2 ]
Radeva, Petia [1 ,2 ]
机构
[1] Univ Autonoma Barcelona, Dept Matemat Aplicada & Anal, Barcelona 08007, Spain
[2] Univ Autonoma Barcelona, Comp Vis Ctr, Barcelona 08007, Spain
关键词
Error-correcting output codes; decoding; multiclass classification; embedding of dichotomizers;
D O I
10.1109/TPAMI.2008.266
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
A common way to model multiclass classification problems is to design a set of binary classifiers and to combine them. Error-Correcting Output Codes (ECOC) represent a successful framework to deal with these type of problems. Recent works in the ECOC framework showed significant performance improvements by means of new problem-dependent designs based on the ternary ECOC framework. The ternary framework contains a larger set of binary problems because of the use of a "do not care" symbol that allows us to ignore some classes by a given classifier. However, there are no proper studies that analyze the effect of the new symbol at the decoding step. In this paper, we present a taxonomy that embeds all binary and ternary ECOC decoding strategies into four groups. We show that the zero symbol introduces two kinds of biases that require redefinition of the decoding design. A new type of decoding measure is proposed, and two novel decoding strategies are defined. We evaluate the state-of-the-art coding and decoding strategies over a set of UCI Machine Learning Repository data sets and into a real traffic sign categorization problem. The experimental results show that, following the new decoding strategies, the performance of the ECOC design is significantly improved.
引用
收藏
页码:120 / 134
页数:15
相关论文
共 30 条
  • [1] Allwein E., 2002, JMLR, V1, P113
  • [2] [Anonymous], P INT C VIS INF ENG
  • [3] [Anonymous], 2007, Uci machine learning repository
  • [4] CASACUBERTA J, 2004, P C INT SOC PHOT REM
  • [5] On the learnability and design of output codes for multiclass problems
    Crammer, K
    Singer, Y
    [J]. MACHINE LEARNING, 2002, 47 (2-3) : 201 - 233
  • [6] DEKEL O, 2002, P C NEUR INF PROC SY, V15
  • [7] Demsar J, 2006, J MACH LEARN RES, V7, P1
  • [8] Dietterich TG, 1994, J ARTIF INTELL RES, V2, P263
  • [9] Boosted Landmarks of Contextual Descriptors and Forest-ECOC: A novel framework to detect and classify objects in cluttered scenes
    Escalera, Sergio
    Pujol, Oriol
    Radeva, Petia
    [J]. PATTERN RECOGNITION LETTERS, 2007, 28 (13) : 1759 - 1768
  • [10] Eun Bae Kong, 1995, Machine Learning. Proceedings of the Twelfth International Conference on Machine Learning, P313