SMOTE for Learning from Imbalanced Data: Progress and Challenges, Marking the 15-year Anniversary

被引:1198
作者
Fernandez, Alberto [1 ]
Garcia, Salvador [1 ]
Herrera, Francisco [1 ]
Chawla, Nitesh V. [2 ,3 ]
机构
[1] Univ Granada, Dept Comp Sci & Artificial Intelligence, Granada, Spain
[2] Univ Notre Dame, Dept Comp Sci & Engn, Notre Dame, IN 46556 USA
[3] Univ Notre Dame, Interdisciplinary Ctr Network Sci & Applicat, Notre Dame, IN 46556 USA
基金
美国国家科学基金会;
关键词
OVER-SAMPLING APPROACH; FEATURE-SELECTION; BIG DATA; DATA-SETS; SVM CLASSIFICATION; DATA GENERATION; MINORITY CLASS; ALGORITHM; FRAMEWORK; PERFORMANCE;
D O I
10.1613/jair.1.11192
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The Synthetic Minority Oversampling Technique (SMOTE) preprocessing algorithm is considered "de facto" standard in the framework of learning from imbalanced data. This is due to its simplicity in the design of the procedure, as well as its robustness when applied to different type of problems. Since its publication in 2002, SMOTE has proven successful in a variety of applications from several different domains. SMOTE has also inspired several approaches to counter the issue of class imbalance, and has also significantly contributed to new supervised learning paradigms, including multilabel classification, incremental learning, semi-supervised learning, multi-instance learning, among others. It is standard benchmark for learning from imbalanced data. It is also featured in a number of different software packages - from open source to commercial. In this paper, marking the fifteen year anniversary of SMOTE, we reflect on the SMOTE journey, discuss the current state of affairs with SMOTE, its applications, and also identify the next set of challenges to extend SMOTE for Big Data problems.
引用
收藏
页码:863 / 905
页数:43
相关论文
共 237 条
[121]   Combining Synthetic Minority Oversampling Technique And Subset Feature Selection Technique For Class Imbalance Problem [J].
Lachheta, Pawan ;
Bawa, Seema .
INTERNATIONAL CONFERENCE ON ADVANCES IN INFORMATION COMMUNICATION TECHNOLOGY & COMPUTING, 2016, 2016,
[122]  
Last M., 2002, Intelligent Data Analysis, V6, P129
[123]  
Lee J., 2015, P 9 INT C UB INF MAN
[124]  
Lemaître G, 2017, J MACH LEARN RES, V18
[125]   Iterative Nearest Neighborhood Oversampling in Semisupervised Learning from Imbalanced Data [J].
Li, Fengqi ;
Yu, Chuang ;
Yang, Nanhai ;
Xia, Feng ;
Li, Guangming ;
Kaveh-Yazdy, Fatemeh .
SCIENTIFIC WORLD JOURNAL, 2013,
[126]  
Li J., INFORM FUSION, V39, P1
[127]   Optimizing SMOTE by Metaheuristics with Neural Network and Decision Tree [J].
Li, Jinyan ;
Fong, Simon ;
Zhuang, Yan .
2015 3RD INTERNATIONAL SYMPOSIUM ON COMPUTATIONAL AND BUSINESS INTELLIGENCE (ISCBI 2015), 2015, :26-32
[128]   An Improved SMOTE Imbalanced Data Classification Method Based on Support Degree [J].
Li, Kewen ;
Zhang, Wenrong ;
Lu, Qinghua ;
Fang, Xianghua .
2014 INTERNATIONAL CONFERENCE ON IDENTIFICATION, INFORMATION AND KNOWLEDGE IN THE INTERNET OF THINGS (IIKI 2014), 2014, :34-38
[129]  
Li Zhang, 2011, Proceedings of the 2011 International Conference on Information Technology, Computer Engineering and Management Sciences (ICM 2011), P393, DOI 10.1109/ICM.2011.34
[130]   Class-imbalanced classifiers for high-dimensional data [J].
Lin, Wei-Jiun ;
Chen, James J. .
BRIEFINGS IN BIOINFORMATICS, 2013, 14 (01) :13-26