Robust chance-constrained support vector machines with second-order moment information

被引:34
作者
Wang, Ximing [1 ]
Fan, Neng [2 ]
Pardalos, Panos M. [1 ]
机构
[1] Univ Florida, Dept Ind & Syst Engn, Gainesville, FL 32611 USA
[2] Univ Arizona, Dept Syst & Ind Engn, Tucson, AZ 85721 USA
关键词
Support vector machines; Robust chance constraints; Semidefinite programming; Second order cone programming; Second-order moment information; Estimation errors; CLASSIFICATION; OPTIMIZATION;
D O I
10.1007/s10479-015-2039-6
中图分类号
C93 [管理学]; O22 [运筹学];
学科分类号
070105 ; 12 ; 1201 ; 1202 ; 120202 ;
摘要
Support vector machines (SVM) is one of the well known supervised classes of learning algorithms. Basic SVM models are dealing with the situation where the exact values of the data points are known. This paper studies SVM when the data points are uncertain. With some properties known for the distributions, chance-constrained SVM is used to ensure the small probability of misclassification for the uncertain data. As infinite number of distributions could have the known properties, the robust chance-constrained SVM requires efficient transformations of the chance constraints to make the problem solvable. In this paper, robust chance-constrained SVM with second-order moment information is studied and we obtain equivalent semidefinite programming and second order cone programming reformulations. The geometric interpretation is presented and numerical experiments are conducted. Three types of estimation errors for mean and covariance information are studied in this paper and the corresponding formulations and techniques to handle these types of errors are presented.
引用
收藏
页码:45 / 68
页数:24
相关论文
共 29 条
[1]  
Abe S, 2010, ADV PATTERN RECOGNIT, P331, DOI 10.1007/978-1-84996-098-4_7
[2]  
Ben-Hur A, 2010, METHODS MOL BIOL, V609, P223, DOI 10.1007/978-1-60327-241-4_13
[3]   Chance constrained uncertain classification via robust optimization [J].
Ben-Tal, Aharon ;
Bhadra, Sahely ;
Bhattacharyya, Chiranjib ;
Nath, J. Saketha .
MATHEMATICAL PROGRAMMING, 2011, 127 (01) :145-173
[4]   Optimal inequalities in probability theory: A convex optimization approach [J].
Bertsimas, D ;
Popescu, I .
SIAM JOURNAL ON OPTIMIZATION, 2005, 15 (03) :780-804
[5]   Robust sparse hyperplane classifiers: Application to uncertain molecular profiling data [J].
Bhattacharyya, C ;
Grate, LR ;
Jordan, MI ;
El Ghaoui, L ;
Mian, IS .
JOURNAL OF COMPUTATIONAL BIOLOGY, 2004, 11 (06) :1073-1089
[6]  
Bi J., 2005, ADV NEURAL INFORM PR
[7]   A tutorial on Support Vector Machines for pattern recognition [J].
Burges, CJC .
DATA MINING AND KNOWLEDGE DISCOVERY, 1998, 2 (02) :121-167
[8]   LIBSVM: A Library for Support Vector Machines [J].
Chang, Chih-Chung ;
Lin, Chih-Jen .
ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY, 2011, 2 (03)
[9]  
CORTES C, 1995, MACH LEARN, V20, P273, DOI 10.1023/A:1022627411411
[10]  
El Ghaoui L, 2003, OPER RES, V51, P543, DOI 10.1287/opre.51.4.543.16101