Curriculum Learning-Based Fuzzy Support Vector Machine

被引:5
作者
Chen, Baihua [1 ]
Gao, Yunlong [3 ]
Liu, Jinghua [4 ]
Weng, Wei [5 ]
Huang, Jiamei [6 ]
Fan, Yuling [2 ]
Lan, Weiyao [1 ]
机构
[1] Xiamen Univ, Dept Automat, Xiamen 361102, Peoples R China
[2] Huaqiao Univ, Coll Engn, Quanzhou 362021, Peoples R China
[3] Xiamen Univ, Pen Tung Sah Inst Micronano Sci & Technol, Xiamen 361021, Peoples R China
[4] Huaqiao Univ, Coll Comp Sci & Technol, Xiamen 362021, Peoples R China
[5] Xiamen Univ Technol, Coll Comp & Informat Engn, Xiamen 361024, Peoples R China
[6] Xiamen Univ, Coll Ocean & Earth Sci, Xiamen 361102, Peoples R China
基金
中国国家自然科学基金;
关键词
Support vector machines; Kernel; Adaptation models; Robustness; Fans; Costs; Optimization; Curriculum learning strategy; density-based clustering; fuzzy support vector machine (FSVM); noise; slack variable;
D O I
10.1109/TFUZZ.2023.3319170
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
To improve the robustness of SVM models to noise and outliers, fuzzy support vector machine (FSVM) has been proposed. However, many existing FSVM models have limitations such as their dependence on assumptions, limited optimization, and unreasonable handling of noise. To address these problems, we propose a novel approach called curriculum learning-based FSVM. Our approach employs a curriculum-learning strategy, where the model initially learns easy samples to avoid noise interference and obtain a good initial solution, before proceeding to learn all samples, including hard ones. To distinguish between easy and hard samples, we introduce an adaptive density-based clustering model, which is extended to kernel feature space. Moreover, we propose a slack variable-based fuzzy membership function to evaluate the importance of samples. Additionally, our model adaptively adapts the importance of samples based on feedback during the learning process. Finally, our experimental results on popular benchmarks demonstrate that our proposed model outperforms existing competitors in terms of accuracy and robustness.
引用
收藏
页码:1116 / 1130
页数:15
相关论文
共 32 条
[1]   Fuzzy C-Means clustering algorithm for data with unequal cluster sizes and contaminated with noise and outliers: Review and development [J].
Askari, Salar .
EXPERT SYSTEMS WITH APPLICATIONS, 2021, 165
[2]   FSVM-CIL: Fuzzy Support Vector Machines for Class Imbalance Learning [J].
Batuwita, Rukshan ;
Palade, Vasile .
IEEE TRANSACTIONS ON FUZZY SYSTEMS, 2010, 18 (03) :558-571
[3]   Fuzzy support vector machine with graph for classifying imbalanced datasets [J].
Chen, Baihua ;
Fan, Yuling ;
Lan, Weiyao ;
Liu, Jinghua ;
Cao, Chao ;
Gao, Yunlong .
NEUROCOMPUTING, 2022, 514 :296-312
[4]  
Demsar J, 2006, J MACH LEARN RES, V7, P1
[5]  
Deng NY, 2012, SUPPORT VECTOR MACHI, DOI DOI 10.1201/B14297
[6]  
Ester M, 1996, Proceedings of the second international conference on knowledge discovery and data mining, P226, DOI DOI 10.5555/3001460.3001507
[7]   Entropy-based fuzzy support vector machine for imbalanced datasets [J].
Fan, Qi ;
Wang, Zhe ;
Li, Dongdong ;
Gao, Daqi ;
Zha, Hongyuan .
KNOWLEDGE-BASED SYSTEMS, 2017, 115 :87-99
[8]   Large-Scale Fuzzy Least Squares Twin SVMs for Class Imbalance Learning [J].
Ganaie, M. A. ;
Tanveer, M. ;
Lin, Chin-Teng .
IEEE TRANSACTIONS ON FUZZY SYSTEMS, 2022, 30 (11) :4815-4827
[9]   Fuzzy twin support vector machine based on affinity and class probability for class imbalance learning [J].
Hazarika, Barenya Bikash ;
Gupta, Deepak ;
Borah, Parashjyoti .
KNOWLEDGE AND INFORMATION SYSTEMS, 2023, 65 (12) :5259-5288
[10]   Affinity based fuzzy kernel ridge regression classifier for binary class imbalance learning [J].
Hazarika, Barenya Bikash ;
Gupta, Deepak .
ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2023, 117