Robust Cost Sensitive Support Vector Machine

被引:0
作者
Katsumata, Shuichi [1 ]
Takeda, Akiko [1 ]
机构
[1] Univ Tokyo, Tokyo, Japan
来源
ARTIFICIAL INTELLIGENCE AND STATISTICS, VOL 38 | 2015年 / 38卷
关键词
CLASSIFICATION;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper we consider robust classifications and show equivalence between the regularized classifications. In general, robust classifications are used to create a classifier robust to data by taking into account the uncertainty of the data. Our result shows that regularized classifications inherit robustness and provide reason on why some regularized classifications tend to be robust against data. Although most robust classification problems assume that every uncertain data lie within an identical bounded set, this paper considers a generalized model where the sizes of the bounded sets are different for each data. These models can be transformed into regularized classification models where the penalties for each data are assigned according to their losses. We see that considering such models opens up for new applications. For an example, we show that this robust classification technique can be used for Imbalanced Data Learning. We conducted experimentation with actual data and compared it with other IDL algorithms such as Cost Sensitive SVMs. This is a novel usage for the robust classification scheme and encourages it to be a suitable candidate for imbalanced data learning.
引用
收藏
页码:434 / 443
页数:10
相关论文
共 25 条
[1]   Applying support vector machines to imbalanced datasets [J].
Akbani, R ;
Kwek, S ;
Japkowicz, N .
MACHINE LEARNING: ECML 2004, PROCEEDINGS, 2004, 3201 :39-50
[2]  
[Anonymous], 1999, Proceedings of the International Joint Conference on Artificial Intelligence
[3]  
[Anonymous], 2009, Advances in Neural Information Processing Systems
[4]  
[Anonymous], 1997, P 14 INT C ONMACHINE
[5]  
Anthony M., 2009, Neural Network Learning: Theoretical Foundations
[6]  
Bach FR, 2006, J MACH LEARN RES, V7, P1713
[7]   Large-Scale Elastic Net Regularized Linear Classification SVMs and Logistic Regression [J].
Balamurugan, P. .
2013 IEEE 13TH INTERNATIONAL CONFERENCE ON DATA MINING (ICDM), 2013, :949-954
[8]   Robust solutions of uncertain quadratic and conic-quadratic problems [J].
Ben-Tal, A ;
Nemirovski, A ;
Roos, C .
SIAM JOURNAL ON OPTIMIZATION, 2002, 13 (02) :535-560
[9]  
BenTal A, 2009, PRINC SER APPL MATH, P1
[10]  
Bhattacharyya C., 2005, P NIPS, P153