A distributionally robust chance-constrained kernel-free quadratic surface support vector machine

被引:2
作者
Lin, Fengming [1 ]
Fang, Shu-Cherng [1 ]
Fang, Xiaolei [1 ]
Gao, Zheming [2 ,4 ]
Luo, Jian [3 ]
机构
[1] North Carolina State Univ, Edward P Fitts Dept Ind & Syst Engn, Raleigh, NC 27695 USA
[2] Northeastern Univ, Coll Informat Sci & Engn, Shenyang 110819, Liaoning, Peoples R China
[3] Hainan Univ, Int Business Sch, Haikou 570228, Hainan, Peoples R China
[4] Yunnan Key Lab Serv Comp, Kunming 650221, Yunnan, Peoples R China
基金
海南省自然科学基金; 中国国家自然科学基金;
关键词
Data science; Kernel-free support vector machine; Robust classification; Distributionally robust optimization; Chance-constrained optimization; CLASSIFICATION; OPTIMIZATION;
D O I
10.1016/j.ejor.2024.02.022
中图分类号
C93 [管理学];
学科分类号
12 ; 1201 ; 1202 ; 120202 ;
摘要
This paper studies the problem of constructing a robust nonlinear classifier when the data set involves uncertainty and only the first- and second -order moments are known a priori. A distributionally robust chanceconstrained kernel -free quadratic surface support vector machine (SVM) model is proposed using the moment information of the uncertain data. The proposed model is reformulated as a semidefinite programming problem and a second -order cone programming problem for efficient computations. A geometric interpretation of the proposed model is also provided. For commonly used data without prescribed uncertainty, a cluster -based data -driven approach is introduced to retrieve the hidden moment information that enables the proposed model for robust classification. Extensive computational experiments using synthetic and public benchmark data sets with or without uncertainty involved support the superior performance of the proposed model over other state-of-the-art SVM models, particularly when the data sets are massive and/or imbalanced.
引用
收藏
页码:46 / 60
页数:15
相关论文
共 36 条
  • [1] Arthur D, 2007, PROCEEDINGS OF THE EIGHTEENTH ANNUAL ACM-SIAM SYMPOSIUM ON DISCRETE ALGORITHMS, P1027
  • [2] Chance constrained uncertain classification via robust optimization
    Ben-Tal, Aharon
    Bhadra, Sahely
    Bhattacharyya, Chiranjib
    Nath, J. Saketha
    [J]. MATHEMATICAL PROGRAMMING, 2011, 127 (01) : 145 - 173
  • [3] Optimal inequalities in probability theory: A convex optimization approach
    Bertsimas, D
    Popescu, I
    [J]. SIAM JOURNAL ON OPTIMIZATION, 2005, 15 (03) : 780 - 804
  • [4] Bertsimas D., 2019, INFORMS J OPTIM, V1, p2 34, DOI DOI 10.1287/IJOO.2018.0001
  • [5] Robust sparse hyperplane classifiers: Application to uncertain molecular profiling data
    Bhattacharyya, C
    Grate, LR
    Jordan, MI
    El Ghaoui, L
    Mian, IS
    [J]. JOURNAL OF COMPUTATIONAL BIOLOGY, 2004, 11 (06) : 1073 - 1089
  • [6] LIBSVM: A Library for Support Vector Machines
    Chang, Chih-Chung
    Lin, Chih-Jen
    [J]. ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY, 2011, 2 (03)
  • [7] SUPPORT-VECTOR NETWORKS
    CORTES, C
    VAPNIK, V
    [J]. MACHINE LEARNING, 1995, 20 (03) : 273 - 297
  • [8] Quadratic kernel-free non-linear support vector machine
    Dagher, Issam
    [J]. JOURNAL OF GLOBAL OPTIMIZATION, 2008, 41 (01) : 15 - 30
  • [9] Distributionally Robust Optimization Under Moment Uncertainty with Application to Data-Driven Problems
    Delage, Erick
    Ye, Yinyu
    [J]. OPERATIONS RESEARCH, 2010, 58 (03) : 595 - 612
  • [10] A kernel-free double well potential support vector machine with applications
    Gao, Zheming
    Fang, Shu-Cherng
    Luo, Jian
    Medhin, Negash
    [J]. EUROPEAN JOURNAL OF OPERATIONAL RESEARCH, 2021, 290 (01) : 248 - 262