SOUL: Scala Oversampling and Undersampling Library for imbalance classification

被引:1
作者
Rodriguez, Nestor [1 ]
Lopez, David [1 ]
Fernandez, Alberto [1 ]
Garcia, Salvador [1 ]
Herrera, Francisco [1 ]
机构
[1] Univ Granada, DaSCI Andalusian Inst Data Sci & Computat Intelli, Granada, Spain
关键词
Oversampling; Undersampling; Scala; Imbalanced classification; SMOTE; PERFORMANCE; CHALLENGES; SELECTION; SPARK;
D O I
10.1016/j.softx.2021.100767
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
The improvements in technology and computation have promoted a global adoption of Data Science. It is devoted to extracting significant knowledge from high amounts of information by means of the application of Artificial Intelligence and Machine Learning tools. Among the different tasks within Data Science, classification is probably the most widespread overall. Focusing on the classification scenario, we often face some datasets in which the number of instances for one of the classes is much lower than that of the remaining ones. This issue is known as the imbalanced classification problem, and it is mainly related to the need for boosting the recognition of the minority class examples. In spite of a large number of solutions that were proposed in the specialized literature to address imbalanced classification, there is a lack of open-source software that compiles the most relevant ones in an easy-to-use and scalable way. In this paper, we present a novel software approach named as SOUL, which stands for Scala Oversampling and Undersampling Library for imbalanced classification. The main capabilities of this new library include a large number of different data preprocessing techniques, efficient execution of these approaches, and a graphical environment to contrast the output for the different preprocessing solutions. (C) 2021 The Authors. Published by Elsevier B.V.
引用
收藏
页数:8
相关论文
共 51 条
  • [1] To Combat Multi-Class Imbalanced Problems by Means of Over-Sampling Techniques
    Abdi, Lida
    Hashemi, Sattar
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2016, 28 (01) : 238 - 251
  • [2] Aggarwal C.C, 2015, Data mining: the textbook, DOI DOI 10.1007/978-3-319-14142-8
  • [3] Alexander Alvin, 2013, Scala Cookbook: Recipes for ObjectOriented and Functional Programming, V1st
  • [4] Armbrust M, 2015, PROC VLDB ENDOW, V8, P1840
  • [5] Barella VH., 2014, BRAZ C INT SYST 3 EN
  • [6] MWMOTE-Majority Weighted Minority Oversampling Technique for Imbalanced Data Set Learning
    Barua, Sukarna
    Islam, Md. Monirul
    Yao, Xin
    Murase, Kazuyuki
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2014, 26 (02) : 405 - 425
  • [7] Batista GE., 2004, ACM SIGKDD EXPL NEWS, V6, P20, DOI [DOI 10.1145/1007730.1007735, 10.1145/1007730.1007735]
  • [8] Beazley D., 2013, Python Cookbook: Recipes for Mastering Python 3, V3rd
  • [9] DBSMOTE: Density-Based Synthetic Minority Over-sampling TEchnique
    Bunkhumpornpat, Chumphol
    Sinapiromsaran, Krung
    Lursinsap, Chidchanok
    [J]. APPLIED INTELLIGENCE, 2012, 36 (03) : 664 - 684
  • [10] Bunkhumpornpat C, 2009, LECT NOTES ARTIF INT, V5476, P475, DOI 10.1007/978-3-642-01307-2_43