Maximum Margin of Twin Spheres Support Vector Machine for Imbalanced Data Classification

被引:69
作者
Xu, Yitian [1 ]
机构
[1] China Agr Univ, Coll Sci, Beijing 100083, Peoples R China
关键词
Homocentric sphere; imbalanced data classification; maximum margin; maximum margin of twin spheres support vector machine (MMTSSVM); twin support vector machine (TSVM); SVM;
D O I
10.1109/TCYB.2016.2551735
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Twin support vector machine (TSVM) finds two nonparallel planes by solving a pair of smaller-sized quadratic programming problems (QPPs) rather than a single large one as in the conventional support vector machine (SVM); this makes the learning speed of TSVM approximately four times faster than that of the standard SVM. One major limitation of TSVM is that it involves an expensive matrix inverse operation when solving the dual problem. In addition, TSVM is less effective when dealing with the imbalanced data. In this paper, we propose a maximum margin of twin spheres support vector machine (MMTSSVM) for imbalanced data classification. MMTSSVM only needs to find two homocentric spheres. On one hand, the small sphere captures as many samples in the majority class as possible; on the other hand, the large sphere pushes out most samples in the minority class by increasing the margin between two homocentric spheres. MMTSSVM involves a QPP and a linear programming problem as opposed to a pair of QPPs as in classical TSVM or a larger-sized QPP in SVM, thus it greatly increases the computational speed. More importantly, MMTSSVM avoids the matrix inverse operation. The property of parameters in MMTSSVM is discussed and testified by one artificial experiment. Experimental results on nine benchmark datasets demonstrate the effectiveness of the proposed MMTSSVM in comparison with state-of-the-art algorithms. Finally, we apply MMTSSVM into Alzheimer's disease medical experiment and also obtain a better experimental result.
引用
收藏
页码:1540 / 1550
页数:11
相关论文
共 50 条
[31]   Fuzzy Locality Preserving Projection Twin Support Vector Machine for Classification [J].
Zhao, Jie ;
Wang, Lei ;
Ji, Hongbing ;
Chen, Shuangyue ;
Li, Danping .
2017 CHINESE AUTOMATION CONGRESS (CAC), 2017, :5859-5864
[32]   A new weighted approach to imbalanced data classification problem via support vector machine with quadratic cost function [J].
Hwang, Jae Pil ;
Park, Seongkeun ;
Kim, Euntai .
EXPERT SYSTEMS WITH APPLICATIONS, 2011, 38 (07) :8580-8585
[33]   Bound estimation-based safe acceleration for maximum margin of twin spheres machine with pinball loss [J].
Yuan, Min ;
Xu, Yitian .
PATTERN RECOGNITION, 2021, 114
[34]   Self-adaptive cost weights-based support vector machine cost-sensitive ensemble for imbalanced data classification [J].
Tao, Xinmin ;
Li, Qing ;
Guo, Wenjie ;
Ren, Chao ;
Li, Chenxi ;
Liu, Rui ;
Zou, Junrong .
INFORMATION SCIENCES, 2019, 487 :31-56
[35]   Support Vector Machine Failure in Imbalanced Datasets [J].
Illan, I. A. ;
Gorriz, J. M. ;
Ramirez, J. ;
Martinez-Murcia, F. J. ;
Castillo-Barnes, D. ;
Segovia, F. ;
Salas-Gonzalez, D. .
UNDERSTANDING THE BRAIN FUNCTION AND EMOTIONS, PT I, 2019, 11486 :412-419
[36]   A novel margin-based twin support vector machine with unity norm hyperplanes [J].
Yuan-Hai Shao ;
Nai-Yang Deng .
Neural Computing and Applications, 2013, 22 :1627-1635
[37]   A novel margin-based twin support vector machine with unity norm hyperplanes [J].
Shao, Yuan-Hai ;
Deng, Nai-Yang .
NEURAL COMPUTING & APPLICATIONS, 2013, 22 (7-8) :1627-1635
[38]   Identification of Single Nucleotide Polymorphism using Support Vector Machine on Imbalanced Data [J].
Hasibuan, Lailan Sahrina ;
Kusuma, Wisnu Ananta ;
Suwarno, Willy Bayuardi .
2014 INTERNATIONAL CONFERENCE ON ADVANCED COMPUTER SCIENCE AND INFORMATION SYSTEMS (ICACSIS), 2014, :375-379
[39]   Fuzzy Support Vector Machine With Relative Density Information for Classifying Imbalanced Data [J].
Yu, Hualong ;
Sun, Changyin ;
Yang, Xibei ;
Zheng, Shang ;
Zou, Haitao .
IEEE TRANSACTIONS ON FUZZY SYSTEMS, 2019, 27 (12) :2353-2367
[40]   Wavelet twin support vector machine [J].
Shifei Ding ;
Fulin Wu ;
Zhongzhi Shi .
Neural Computing and Applications, 2014, 25 :1241-1247