The Multiclass ROC Front method for cost-sensitive classification

被引:19
作者
Bernard, Simon [1 ]
Chatelain, Clement [2 ]
Adam, Sebastien [1 ]
Sabourin, Robert [3 ]
机构
[1] Univ Rouen, LITIS EA 4108, BP 12, F-76801 St Etienne, France
[2] INSA Rouen, LITIS EA 4108, BP 12, F-76801 St Etienne, France
[3] Univ Quebec, Ecole Technol Super, Lab Imagerie Vis & & Intelligence Artificielle, Montreal, PQ H3C 3P8, Canada
关键词
Multiclass classification; Cost-sensitive classification; ROC optimization; Multi-objective optimization; SVM classifier;
D O I
10.1016/j.patcog.2015.10.010
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper addresses the problem of learning a multiclass classification system that can suit to any environment. By that we mean that particular (imbalanced) misclassification costs are taken into account by the classifier for predictions. However, these costs are not well known during the learning phase in most cases, or may evolve afterwards. There is a need in that case to learn a classifier that can potentially suit to any of these costs in prediction phase. The learning method proposed in this work, named the Multiclass ROC Front (MROCF) method, responds to this issue by exploiting ROC-based tools through a multiobjective optimization process. While this type of ROC-based multiobjective optimization approach has been successfully used for two-class problems, it has never been proposed in real-world multiclass classification problems. Experiments led on several real-world datasets show that the MROCF method offers a major improvement over a cost-insensitive classifier and is competitive with the state-of-the-art cost-sensitive optimization method on all but one of the 20 datasets. (C) 2015 Elsevier Ltd. All rights reserved.
引用
收藏
页码:46 / 60
页数:15
相关论文
共 34 条
  • [1] [Anonymous], 2005, P ICML 2005 WORKSH R
  • [2] [Anonymous], P EUR C ART INT 1 WO
  • [3] [Anonymous], 2003, C45 CLASS IMBALANCE
  • [4] [Anonymous], 2003, Journal of machine learning research
  • [5] [Anonymous], MULTIOBJECTIVE PROBL
  • [6] Bache K., 2013, UCI Machine Learning Repository
  • [7] Bergstra J, 2012, J MACH LEARN RES, V13, P281
  • [8] Bernard S, 2007, PROC INT CONF DOC, P1043
  • [9] On reoptimizing multi-class classifiers
    Bourke, Chris
    Deng, Kun
    Scott, Stephen D.
    Schapire, Robert E.
    Vinodchandran, N. V.
    [J]. MACHINE LEARNING, 2008, 71 (2-3) : 219 - 242
  • [10] A multi-model selection framework for unknown and/or evolutive misclassification cost problems
    Chatelain, Clement
    Adam, Sebastien
    Lecourtier, Yves
    Heutte, Laurent
    Paquet, Thierry
    [J]. PATTERN RECOGNITION, 2010, 43 (03) : 815 - 823