SMOTE for Learning from Imbalanced Data: Progress and Challenges, Marking the 15-year Anniversary

被引:1198
作者
Fernandez, Alberto [1 ]
Garcia, Salvador [1 ]
Herrera, Francisco [1 ]
Chawla, Nitesh V. [2 ,3 ]
机构
[1] Univ Granada, Dept Comp Sci & Artificial Intelligence, Granada, Spain
[2] Univ Notre Dame, Dept Comp Sci & Engn, Notre Dame, IN 46556 USA
[3] Univ Notre Dame, Interdisciplinary Ctr Network Sci & Applicat, Notre Dame, IN 46556 USA
基金
美国国家科学基金会;
关键词
OVER-SAMPLING APPROACH; FEATURE-SELECTION; BIG DATA; DATA-SETS; SVM CLASSIFICATION; DATA GENERATION; MINORITY CLASS; ALGORITHM; FRAMEWORK; PERFORMANCE;
D O I
10.1613/jair.1.11192
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The Synthetic Minority Oversampling Technique (SMOTE) preprocessing algorithm is considered "de facto" standard in the framework of learning from imbalanced data. This is due to its simplicity in the design of the procedure, as well as its robustness when applied to different type of problems. Since its publication in 2002, SMOTE has proven successful in a variety of applications from several different domains. SMOTE has also inspired several approaches to counter the issue of class imbalance, and has also significantly contributed to new supervised learning paradigms, including multilabel classification, incremental learning, semi-supervised learning, multi-instance learning, among others. It is standard benchmark for learning from imbalanced data. It is also featured in a number of different software packages - from open source to commercial. In this paper, marking the fifteen year anniversary of SMOTE, we reflect on the SMOTE journey, discuss the current state of affairs with SMOTE, its applications, and also identify the next set of challenges to extend SMOTE for Big Data problems.
引用
收藏
页码:863 / 905
页数:43
相关论文
共 237 条
[101]  
Hu F., 2014, JOURNAL OF INFORMATION COMPUTATIONAL SCIENCE, V11, P4655
[102]   A Novel Boundary Oversampling Algorithm Based on Neighborhood Rough Set Model: NRSBoundary-SMOTE [J].
Hu, Feng ;
Li, Hang .
MATHEMATICAL PROBLEMS IN ENGINEERING, 2013, 2013
[103]  
Hukerikar S., 2011, 2011 2nd International Conference on Computer and Communication Technology, P46, DOI 10.1109/ICCCT.2011.6075185
[104]  
Hwang D, 2003, THIRD IEEE SYMPOSIUM ON BIOINFORMATICS AND BIOENGINEERING - BIBE 2003, PROCEEDINGS, P436
[105]   An HMM-based over-sampling technique to improve text classification [J].
Iglesias, E. L. ;
Seara Vieira, A. ;
Borrajo, L. .
EXPERT SYSTEMS WITH APPLICATIONS, 2013, 40 (18) :7184-7192
[106]  
Japkowicz N., 2000, AI MAG, V22, P127
[107]  
Jeatrakul P., 2012, The 2012 International Joint Conference on Neural Networks (IJCNN), P1
[108]   A Novel Algorithm for Imbalance Data Classification Based on Genetic Algorithm Improved SMOTE [J].
Jiang, Kun ;
Lu, Jing ;
Xia, Kuiliang .
ARABIAN JOURNAL FOR SCIENCE AND ENGINEERING, 2016, 41 (08) :3255-3266
[109]   A Novel Minority Cloning Technique for Cost-Sensitive Learning [J].
Jiang, Liangxiao ;
Qiu, Chen ;
Li, Chaoqun .
INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2015, 29 (04)
[110]  
Jo T., 2004, ACM Sigkdd Explor. Newsl, V6, P40, DOI DOI 10.1145/1007730.1007737