Maximum Margin of Twin Spheres Support Vector Machine for Imbalanced Data Classification

被引:69
作者
Xu, Yitian [1 ]
机构
[1] China Agr Univ, Coll Sci, Beijing 100083, Peoples R China
关键词
Homocentric sphere; imbalanced data classification; maximum margin; maximum margin of twin spheres support vector machine (MMTSSVM); twin support vector machine (TSVM); SVM;
D O I
10.1109/TCYB.2016.2551735
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Twin support vector machine (TSVM) finds two nonparallel planes by solving a pair of smaller-sized quadratic programming problems (QPPs) rather than a single large one as in the conventional support vector machine (SVM); this makes the learning speed of TSVM approximately four times faster than that of the standard SVM. One major limitation of TSVM is that it involves an expensive matrix inverse operation when solving the dual problem. In addition, TSVM is less effective when dealing with the imbalanced data. In this paper, we propose a maximum margin of twin spheres support vector machine (MMTSSVM) for imbalanced data classification. MMTSSVM only needs to find two homocentric spheres. On one hand, the small sphere captures as many samples in the majority class as possible; on the other hand, the large sphere pushes out most samples in the minority class by increasing the margin between two homocentric spheres. MMTSSVM involves a QPP and a linear programming problem as opposed to a pair of QPPs as in classical TSVM or a larger-sized QPP in SVM, thus it greatly increases the computational speed. More importantly, MMTSSVM avoids the matrix inverse operation. The property of parameters in MMTSSVM is discussed and testified by one artificial experiment. Experimental results on nine benchmark datasets demonstrate the effectiveness of the proposed MMTSSVM in comparison with state-of-the-art algorithms. Finally, we apply MMTSSVM into Alzheimer's disease medical experiment and also obtain a better experimental result.
引用
收藏
页码:1540 / 1550
页数:11
相关论文
共 50 条
[21]   A twin projection support vector machine for data regression [J].
Peng, Xinjun ;
Xu, Dong ;
Shen, Jindong .
NEUROCOMPUTING, 2014, 138 :131-141
[22]   Geometric projection twin support vector machine for pattern classification [J].
Chen, Xiaobo ;
Xiao, Yan .
MULTIMEDIA TOOLS AND APPLICATIONS, 2021, 80 (15) :23073-23089
[23]   Coordinate Descent Fuzzy Twin Support Vector Machine for Classification [J].
Gao, Bin-Bin ;
Wang, Jian-Jun ;
Wang, Yao ;
Yang, Chan-Yun .
2015 IEEE 14TH INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS (ICMLA), 2015, :7-12
[24]   A new fuzzy twin support vector machine for pattern classification [J].
Chen, Su-Gen ;
Wu, Xiao-Jun .
INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2018, 9 (09) :1553-1564
[25]   Imbalanced Hyperspectral Image Classification Based on Maximum Margin [J].
Sun, Tao ;
Jiao, Licheng ;
Feng, Jie ;
Liu, Fang ;
Zhang, Xiangrong .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2015, 12 (03) :522-526
[26]   An Imbalanced Data Classification Method Based on Hybrid Resampling and Fine Cost Sensitive Support Vector Machine [J].
Zhu, Bo ;
Jing, Xiaona ;
Qiu, Lan ;
Li, Runbo .
CMC-COMPUTERS MATERIALS & CONTINUA, 2024, 79 (03) :3977-3999
[27]   Classification of Imbalanced Data by Oversampling in Kernel Space of Support Vector Machines [J].
Mathew, Josey ;
Pang, Chee Khiang ;
Luo, Ming ;
Leong, Weng Hoe .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2018, 29 (09) :4065-4076
[28]   Support vector machine with quantile hyper-spheres for pattern classification [J].
Chu, Maoxiang ;
Liu, Xiaoping ;
Gong, Rongfen ;
Zhao, Jie .
PLOS ONE, 2019, 14 (02)
[29]   An Adaptive Pre-clustering Support Vector Machine for Binary Imbalanced Classification [J].
Di, Zonglin ;
Yao, Siya ;
Kang, Qi ;
Zhou, Mengchu .
2018 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2018, :681-686
[30]   EEG Signal Classification Using a Novel Universum-Based Twin Parametric-Margin Support Vector Machine [J].
Hazarika, Barenya Bikash ;
Gupta, Deepak ;
Kumar, Bikram .
COGNITIVE COMPUTATION, 2024, 16 (04) :2047-2062