A new boundary-degree-based oversampling method for imbalanced data

被引:8
作者
Chen, Yueqi [1 ,2 ]
Pedrycz, Witold [3 ,4 ,5 ]
Yang, Jie [1 ,2 ]
机构
[1] Dalian Univ Technol, Sch Math Sci, Dalian 116024, Liaoning, Peoples R China
[2] Key Lab Computat Math & Data Intelligence Liaonin, Dalian 116024, Liaoning, Peoples R China
[3] Univ Alberta, Dept Elect & Comp Engn, Edmonton, AB T6G 2R3, Canada
[4] Polish Acad Sci, Syst Res Inst, PL-00901 Warsaw, Mazowieckie, Poland
[5] Istinye Univ, Fac Engn & Nat Sci, Dept Comp Engn, Istanbul 34460, Turkiye
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
Imbalanced learning; Information entropy; Gradient; Gaussian probability distribution function; Oversampling; SMOTE; CLASSIFICATION; ALGORITHM; FRAMEWORK;
D O I
10.1007/s10489-023-04846-4
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Imbalanced data constitute a significant challenge in practical applications, as standard classifiers are usually designed to work on data with balanced class label distributions. One of effective methods to solve the imbalanced problem is boundary oversampling method, which only focuses on the classification of boundary samples. However, most boundary oversampling methods roughly select boundary samples for oversampling without considering the potentially useful boundary characteristics inherent in majority (negative) class. To overcome this limitation, we propose a novel boundary-degree-based oversampling method (BDO) in this paper. The originality of BDO stemps from quantifying the degree to which each negative sample can be regarded as a boundary sample in terms of probability using information entropy. Applying the sigma rule on the quantified boundary degree, negative boundary samples are determined to indirectly select minority (positive) boundary samples for oversampling. In this way, a substantial amount of information hidden in the negative class can be mined. To further transfer the mined information to help oversample, BDO iteratively synthesizes aided boundary points along a fraudulent gradient. Oversampling finally is performed on both positive boundary samples and the aided boundary points. Experimental results completed on 15 benchmark imbalanced datasets, two multi-label datasets and one large-scale dataset in terms of G-mean, F-measure, AUC, accuracy, TPR and TNR show that BDO exhibits better performance, which is competitive with some commonly considered methods.
引用
收藏
页码:26518 / 26541
页数:24
相关论文
共 45 条
[1]   Classification of COVID-19 in chest X-ray images using DeTraC deep convolutional neural network [J].
Abbas, Asmaa ;
Abdelsamea, Mohammed M. ;
Gaber, Mohamed Medhat .
APPLIED INTELLIGENCE, 2021, 51 (02) :854-864
[2]   Multivariable models including artificial neural network and M5P-tree to forecast the stress at the failure of alkali-activated concrete at ambient curing condition and various mixture proportions [J].
Ahmed, Hemn Unis ;
Mohammed, Ahmed S. ;
Mohammed, Azad A. .
NEURAL COMPUTING & APPLICATIONS, 2022, 34 (20) :17853-17876
[3]   A framework for fake review detection in online consumer electronics retailers [J].
Barbado, Rodrigo ;
Araque, Oscar ;
Iglesias, Carlos A. .
INFORMATION PROCESSING & MANAGEMENT, 2019, 56 (04) :1234-1244
[4]   SMOTE: Synthetic minority over-sampling technique [J].
Chawla, Nitesh V. ;
Bowyer, Kevin W. ;
Hall, Lawrence O. ;
Kegelmeyer, W. Philip .
2002, American Association for Artificial Intelligence (16)
[5]  
Choi K, 2021, ADV NEUR IN, V34
[6]   DeepSMOTE: Fusing Deep Learning and SMOTE for Imbalanced Data [J].
Dablain, Damien ;
Krawczyk, Bartosz ;
Chawla, Nitesh, V .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 34 (09) :6390-6404
[7]   A high-speed D-CART online fault diagnosis algorithm for rotor systems [J].
Deng, Huaxia ;
Diao, Yifan ;
Wu, Wei ;
Zhang, Jin ;
Ma, Mengchao ;
Zhong, Xiang .
APPLIED INTELLIGENCE, 2020, 50 (01) :29-41
[8]   RGAN-EL: A GAN and ensemble learning-based hybrid approach for imbalanced data classification [J].
Ding, Hongwei ;
Sun, Yu ;
Wang, Zhenyu ;
Huang, Nana ;
Shen, Zhidong ;
Cui, Xiaohui .
INFORMATION PROCESSING & MANAGEMENT, 2023, 60 (02)
[9]   Improving imbalanced learning through a heuristic oversampling method based on k-means and SMOTE [J].
Douzas, Georgios ;
Bacao, Fernando ;
Last, Felix .
INFORMATION SCIENCES, 2018, 465 :1-20
[10]   Self-Organizing Map Oversampling (SOMO) for imbalanced data set learning [J].
Douzas, Georgios ;
Bacao, Fernando .
EXPERT SYSTEMS WITH APPLICATIONS, 2017, 82 :40-52