A new boundary-degree-based oversampling method for imbalanced data

被引:8
作者
Chen, Yueqi [1 ,2 ]
Pedrycz, Witold [3 ,4 ,5 ]
Yang, Jie [1 ,2 ]
机构
[1] Dalian Univ Technol, Sch Math Sci, Dalian 116024, Liaoning, Peoples R China
[2] Key Lab Computat Math & Data Intelligence Liaonin, Dalian 116024, Liaoning, Peoples R China
[3] Univ Alberta, Dept Elect & Comp Engn, Edmonton, AB T6G 2R3, Canada
[4] Polish Acad Sci, Syst Res Inst, PL-00901 Warsaw, Mazowieckie, Poland
[5] Istinye Univ, Fac Engn & Nat Sci, Dept Comp Engn, Istanbul 34460, Turkiye
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
Imbalanced learning; Information entropy; Gradient; Gaussian probability distribution function; Oversampling; SMOTE; CLASSIFICATION; ALGORITHM; FRAMEWORK;
D O I
10.1007/s10489-023-04846-4
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Imbalanced data constitute a significant challenge in practical applications, as standard classifiers are usually designed to work on data with balanced class label distributions. One of effective methods to solve the imbalanced problem is boundary oversampling method, which only focuses on the classification of boundary samples. However, most boundary oversampling methods roughly select boundary samples for oversampling without considering the potentially useful boundary characteristics inherent in majority (negative) class. To overcome this limitation, we propose a novel boundary-degree-based oversampling method (BDO) in this paper. The originality of BDO stemps from quantifying the degree to which each negative sample can be regarded as a boundary sample in terms of probability using information entropy. Applying the sigma rule on the quantified boundary degree, negative boundary samples are determined to indirectly select minority (positive) boundary samples for oversampling. In this way, a substantial amount of information hidden in the negative class can be mined. To further transfer the mined information to help oversample, BDO iteratively synthesizes aided boundary points along a fraudulent gradient. Oversampling finally is performed on both positive boundary samples and the aided boundary points. Experimental results completed on 15 benchmark imbalanced datasets, two multi-label datasets and one large-scale dataset in terms of G-mean, F-measure, AUC, accuracy, TPR and TNR show that BDO exhibits better performance, which is competitive with some commonly considered methods.
引用
收藏
页码:26518 / 26541
页数:24
相关论文
共 45 条
[21]   Deep reinforcement learning for imbalanced classification [J].
Lin, Enlu ;
Chen, Qiong ;
Qi, Xiaoming .
APPLIED INTELLIGENCE, 2020, 50 (08) :2488-2502
[22]   Noise-robust oversampling for imbalanced data classification [J].
Liu, Yongxu ;
Liu, Yan ;
Yu, Bruce X. B. ;
Zhong, Shenghua ;
Hu, Zhejing .
PATTERN RECOGNITION, 2023, 133
[23]   The Role of Entropy in Construct Specification Equations (CSE) to Improve the Validity of Memory Tests: Extension to Word Lists [J].
Melin, Jeanette ;
Cano, Stefan ;
Floeel, Agnes ;
Goeschel, Laura ;
Pendrill, Leslie .
ENTROPY, 2022, 24 (07)
[24]  
Nguyen Hien M., 2011, International Journal of Knowledge Engineering and Soft Data Paradigms, V3, P4, DOI 10.1504/IJKESDP.2011.039875
[25]   XGBoost Model for Chronic Kidney Disease Diagnosis [J].
Ogunleye, Adeola ;
Wang, Qing-Guo .
IEEE-ACM TRANSACTIONS ON COMPUTATIONAL BIOLOGY AND BIOINFORMATICS, 2020, 17 (06) :2131-2140
[26]   MLTL: A multi-label approach for the Tomek Link undersampling algorithm [J].
Pereira, Rodolfo M. ;
Costa, Yandre M. G. ;
Silla Jr, Carlos N. .
NEUROCOMPUTING, 2020, 383 :95-105
[27]   Improved Hybrid Bag-Boost Ensemble With K-Means-SMOTE-ENN Technique for Handling Noisy Class Imbalanced Data [J].
Puri, Arjun ;
Gupta, Manoj Kumar .
COMPUTER JOURNAL, 2022, 65 (01) :124-138
[28]   Grouping-based Oversampling in Kernel Space for Imbalanced Data Classification [J].
Ren, Jinjun ;
Wang, Yuping ;
Cheung, Yiu-ming ;
Gao, Xiao-Zhi ;
Guo, Xiaofang .
PATTERN RECOGNITION, 2023, 133
[29]   Adaptive cost-sensitive learning: Improving the convergence of intelligent diagnosis models under imbalanced data [J].
Ren, Zhijun ;
Zhu, Yongsheng ;
Kang, Wei ;
Fu, Hong ;
Niu, Qingbo ;
Gao, Dawei ;
Yan, Ke ;
Hong, Jun .
KNOWLEDGE-BASED SYSTEMS, 2022, 241
[30]   Noise Reduction A Priori Synthetic Over-Sampling for class imbalanced data sets [J].
Rivera, William A. .
INFORMATION SCIENCES, 2017, 408 :146-161