SMOTE for Learning from Imbalanced Data: Progress and Challenges, Marking the 15-year Anniversary

被引:1198
作者
Fernandez, Alberto [1 ]
Garcia, Salvador [1 ]
Herrera, Francisco [1 ]
Chawla, Nitesh V. [2 ,3 ]
机构
[1] Univ Granada, Dept Comp Sci & Artificial Intelligence, Granada, Spain
[2] Univ Notre Dame, Dept Comp Sci & Engn, Notre Dame, IN 46556 USA
[3] Univ Notre Dame, Interdisciplinary Ctr Network Sci & Applicat, Notre Dame, IN 46556 USA
基金
美国国家科学基金会;
关键词
OVER-SAMPLING APPROACH; FEATURE-SELECTION; BIG DATA; DATA-SETS; SVM CLASSIFICATION; DATA GENERATION; MINORITY CLASS; ALGORITHM; FRAMEWORK; PERFORMANCE;
D O I
10.1613/jair.1.11192
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The Synthetic Minority Oversampling Technique (SMOTE) preprocessing algorithm is considered "de facto" standard in the framework of learning from imbalanced data. This is due to its simplicity in the design of the procedure, as well as its robustness when applied to different type of problems. Since its publication in 2002, SMOTE has proven successful in a variety of applications from several different domains. SMOTE has also inspired several approaches to counter the issue of class imbalance, and has also significantly contributed to new supervised learning paradigms, including multilabel classification, incremental learning, semi-supervised learning, multi-instance learning, among others. It is standard benchmark for learning from imbalanced data. It is also featured in a number of different software packages - from open source to commercial. In this paper, marking the fifteen year anniversary of SMOTE, we reflect on the SMOTE journey, discuss the current state of affairs with SMOTE, its applications, and also identify the next set of challenges to extend SMOTE for Big Data problems.
引用
收藏
页码:863 / 905
页数:43
相关论文
共 237 条
[91]   ADASYN: Adaptive Synthetic Sampling Approach for Imbalanced Learning [J].
He, Haibo ;
Bai, Yang ;
Garcia, Edwardo A. ;
Li, Shutao .
2008 IEEE INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, VOLS 1-8, 2008, :1322-1328
[92]  
Herrera F., 2016, Multilabel Classification
[93]  
Herrera F., 2016, Multiple instance learning, DOI 10.1007/978-3-319-47759-6
[94]  
Ho TK, 2002, IEEE T PATTERN ANAL, V24, P289, DOI 10.1109/34.990132
[95]  
Hoens T. Ryan, 2012, Advances in Knowledge Discovery and Data Mining. Proceedings 16th Pacific-Asia Conference (PAKDD 2012), P122, DOI 10.1007/978-3-642-30217-6_11
[96]  
Hoens T. R., 2011, Proceedings of the 2011 IEEE 11th International Conference on Data Mining (ICDM 2011), P241, DOI 10.1109/ICDM.2011.75
[97]  
Hoens TR, 2013, IMBALANCED LEARNING: FOUNDATIONS, ALGORITHMS, AND APPLICATIONS, P43
[98]   Learning from streaming data with concept drift and imbalance: an overview [J].
Hoens, T. Ryan ;
Polikar, Robi ;
Chawla, Nitesh V. .
PROGRESS IN ARTIFICIAL INTELLIGENCE, 2012, 1 (01) :89-101
[99]  
Hoens TR, 2010, LECT NOTES ARTIF INT, V6119, P488
[100]  
Hong Cao, 2011, Proceedings of the 2011 IEEE 11th International Conference on Data Mining (ICDM 2011), P1008, DOI 10.1109/ICDM.2011.137