Maximum Margin of Twin Spheres Support Vector Machine for Imbalanced Data Classification

被引:74
作者
Xu, Yitian [1 ]
机构
[1] China Agr Univ, Coll Sci, Beijing 100083, Peoples R China
关键词
Homocentric sphere; imbalanced data classification; maximum margin; maximum margin of twin spheres support vector machine (MMTSSVM); twin support vector machine (TSVM); SVM;
D O I
10.1109/TCYB.2016.2551735
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Twin support vector machine (TSVM) finds two nonparallel planes by solving a pair of smaller-sized quadratic programming problems (QPPs) rather than a single large one as in the conventional support vector machine (SVM); this makes the learning speed of TSVM approximately four times faster than that of the standard SVM. One major limitation of TSVM is that it involves an expensive matrix inverse operation when solving the dual problem. In addition, TSVM is less effective when dealing with the imbalanced data. In this paper, we propose a maximum margin of twin spheres support vector machine (MMTSSVM) for imbalanced data classification. MMTSSVM only needs to find two homocentric spheres. On one hand, the small sphere captures as many samples in the majority class as possible; on the other hand, the large sphere pushes out most samples in the minority class by increasing the margin between two homocentric spheres. MMTSSVM involves a QPP and a linear programming problem as opposed to a pair of QPPs as in classical TSVM or a larger-sized QPP in SVM, thus it greatly increases the computational speed. More importantly, MMTSSVM avoids the matrix inverse operation. The property of parameters in MMTSSVM is discussed and testified by one artificial experiment. Experimental results on nine benchmark datasets demonstrate the effectiveness of the proposed MMTSSVM in comparison with state-of-the-art algorithms. Finally, we apply MMTSSVM into Alzheimer's disease medical experiment and also obtain a better experimental result.
引用
收藏
页码:1540 / 1550
页数:11
相关论文
共 50 条
[41]   Fuzzy Support Vector Machine With Relative Density Information for Classifying Imbalanced Data [J].
Yu, Hualong ;
Sun, Changyin ;
Yang, Xibei ;
Zheng, Shang ;
Zou, Haitao .
IEEE TRANSACTIONS ON FUZZY SYSTEMS, 2019, 27 (12) :2353-2367
[42]   Wavelet twin support vector machine [J].
Shifei Ding ;
Fulin Wu ;
Zhongzhi Shi .
Neural Computing and Applications, 2014, 25 :1241-1247
[43]   Wavelet twin support vector machine [J].
Ding, Shifei ;
Wu, Fulin ;
Shi, Zhongzhi .
NEURAL COMPUTING & APPLICATIONS, 2014, 25 (06) :1241-1247
[44]   EEG signal classification via pinball universum twin support vector machine [J].
Ganaie, M. A. ;
Tanveer, M. ;
Jangir, Jatin .
ANNALS OF OPERATIONS RESEARCH, 2023, 328 (01) :451-492
[45]   Improved support vector machine and classification for remotely sensed data [J].
ZHANG RuiMA Jianwen Institute of Remote Sensing ApplicationsChinese Academy of SciencesBeijing ChinaGraduate UniversityChinese Academy of SciencesBeijing China .
遥感学报, 2009, 13 (03) :437-444
[46]   A SMOTE-BASED QUADRATIC SURFACE SUPPORT VECTOR MACHINE FOR IMBALANCED CLASSIFICATION WITH MISLABELED INFORMATION [J].
Zhai, Qianru ;
Tian, Ye ;
Zhou, Jingyue .
JOURNAL OF INDUSTRIAL AND MANAGEMENT OPTIMIZATION, 2023, 19 (02) :1310-1327
[47]   Instance categorization by support vector machines to adjust weights in AdaBoost for imbalanced data classification [J].
Lee, Wonji ;
Jun, Chi-Hyuck ;
Lee, Jong-Seok .
INFORMATION SCIENCES, 2017, 381 :92-103
[48]   Concave-Convex Programming for Ramp Loss-Based Maximum Margin and Minimum Volume Twin Spheres Machine [J].
Wang, Qian ;
Xu, Yitian .
NEURAL PROCESSING LETTERS, 2019, 50 (02) :1093-1114
[49]   Concave-Convex Programming for Ramp Loss-Based Maximum Margin and Minimum Volume Twin Spheres Machine [J].
Qian Wang ;
Yitian Xu .
Neural Processing Letters, 2019, 50 :1093-1114
[50]   Multi-class Twin Support Vector Machine for Pattern Classification2 [J].
Tomar, Divya ;
Agarwal, Sonali .
PROCEEDINGS OF 3RD INTERNATIONAL CONFERENCE ON ADVANCED COMPUTING, NETWORKING AND INFORMATICS (ICACNI 2015), VOL 1, 2016, 43 :97-110