A novel kernel-free least squares twin support vector machine for fast and accurate multi-class classification

被引:26
|
作者
Gao, Zheming [1 ]
Fang, Shu-Cherng [2 ]
Gao, Xuerui [3 ]
Luo, Jian [4 ]
Medhin, Negash [5 ]
机构
[1] Northeastern Univ, Coll Informat Sci & Engn, Shenyang 110819, Liaoning, Peoples R China
[2] North Carolina State Univ, Edward P Fitts Dept Ind & Syst Engn, Raleigh, NC 27695 USA
[3] Shanghai Univ, Dept Math, Shanghai 200444, Peoples R China
[4] Dongbei Univ Finance & Econ, Sch Management Sci & Engn, Dalian 116025, Peoples R China
[5] North Carolina State Univ, Dept Math, Raleigh, NC 27695 USA
基金
中国国家自然科学基金;
关键词
Multi-class classification; Least squares twin support vector machine; Double well potential; Kernel-free SVM; Imbalanced data; WELL POTENTIAL FUNCTION; DIMENSIONAL REAL-SPACE; OPTIMIZATION;
D O I
10.1016/j.knosys.2021.107123
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Multi-class classification is an important and challenging research topic with many real-life applications. The problem is much harder than the classical binary classification, especially when the given data set is imbalanced. Hidden nonlinear patterns in the data set can further complicate the task of multi-class classification. In this paper, we propose a kernel-free least squares twin support vector machine for multi-class classification. The proposed model employs a special fourth order polynomial surface, namely the double well potential surface, and adopts the "one-verses-all" classification strategy. An l(2) regularization term is added to accommodate data sets with different levels of nonlinearity. We provide some theoretical analysis of the proposed model. Computational results using artificial data sets and public benchmarks clearly show the superior performance of the proposed model over other well-known multi-class classification methods, in particular for imbalanced data sets. (C) 2021 Elsevier B.V. All rights reserved.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] Least squares twin multi-class classification support vector machine
    Nasiri, Jalal A.
    Charkari, Nasrollah Moghadam
    Jalili, Saeed
    PATTERN RECOGNITION, 2015, 48 (03) : 984 - 992
  • [2] Least squares twin support vector machine for multi-class classification
    Chen, Sugen
    Xu, Juan
    International Journal of Database Theory and Application, 2015, 8 (05): : 65 - 76
  • [3] Improvements on least squares twin multi-class classification support vector machine
    de Lima, Marcio Dias
    Costa, Nattane Luiza
    Barbosa, Rommel
    NEUROCOMPUTING, 2018, 313 : 196 - 205
  • [4] Least squares recursive projection twin support vector machine for multi-class classification
    Yang, Zhi-Min
    Wu, He-Ji
    Li, Chun-Na
    Shao, Yuan-Hai
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2016, 7 (03) : 411 - 426
  • [5] Least squares recursive projection twin support vector machine for multi-class classification
    Zhi-Min Yang
    He-Ji Wu
    Chun-Na Li
    Yuan-Hai Shao
    International Journal of Machine Learning and Cybernetics, 2016, 7 : 411 - 426
  • [6] Quadratic kernel-free least squares support vector machine for target diseases classification
    Yanqin Bai
    Xiao Han
    Tong Chen
    Hua Yu
    Journal of Combinatorial Optimization, 2015, 30 : 850 - 870
  • [7] Quadratic kernel-free least squares support vector machine for target diseases classification
    Bai, Yanqin
    Han, Xiao
    Chen, Tong
    Yu, Hua
    JOURNAL OF COMBINATORIAL OPTIMIZATION, 2015, 30 (04) : 850 - 870
  • [8] A comparison on multi-class classification methods based on least squares twin support vector machine
    Tomar, Divya
    Agarwal, Sonali
    KNOWLEDGE-BASED SYSTEMS, 2015, 81 : 131 - 147
  • [9] Quadratic Kernel-Free Least Square Twin Support Vector Machine for Binary Classification Problems
    Gao, Qian-Qian
    Bai, Yan-Qin
    Zhan, Ya-Ru
    JOURNAL OF THE OPERATIONS RESEARCH SOCIETY OF CHINA, 2019, 7 (04) : 539 - 559
  • [10] An Advanced Least Squares Twin Multi-class Classification Support Vector Machine for Few-Shot Classification
    Li, Yu
    Liu, Zhonggeng
    Pan, Huadong
    Yin, Jun
    Zhang, Xingming
    INTELLIGENCE SCIENCE AND BIG DATA ENGINEERING: BIG DATA AND MACHINE LEARNING, PT II, 2019, 11936 : 243 - 252