AutoAD: an Automated Framework for Unsupervised Anomaly Detection

被引:1
作者
Putina, Andrian [1 ]
Bahri, Maroua [2 ]
Salutari, Flavia [1 ]
Sozio, Mauro [1 ]
机构
[1] IP Paris, Telecom Paris, LTCI, Palaiseau, France
[2] Inria Paris, MiMove, Paris, France
来源
2022 IEEE 9TH INTERNATIONAL CONFERENCE ON DATA SCIENCE AND ADVANCED ANALYTICS (DSAA) | 2022年
关键词
Anomaly detection; autoML; unsupervised learning; ALGORITHMS;
D O I
10.1109/DSAA54385.2022.10032396
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Over the last decade, we witnessed the proliferation of several machine learning algorithms capable of solving different tasks for the most diverse applications. Often, for an algorithm to be effective, significant human effort is required, in particular for hyper-parameter tuning and data cleaning. Recently, there have been increasing efforts to alleviate such a burden and make machine learning algorithms easier to use for researchers with varying levels of expertise. Nevertheless, the question of whether an efficient and fully generalizable automated Machine Learning (autoML) framework is possible remains unanswered. In this paper, we present autoAD, the first autoML framework for unsupervised anomaly detection. By leveraging a pool of different anomaly detection algorithms, each one coming with its own hyper-parameter search space, our framework automatically selects the best performing approach, while determining an optimal configuration for its hyperparameters on a given dataset. Our extensive experimental evaluation, conducted on a rich collection of datasets, shows the substantial gains that can be achieved with autoAD compared to state-of-the-art methods for unsupervised anomaly detection.
引用
收藏
页码:106 / 115
页数:10
相关论文
共 31 条
[1]  
[Anonymous], 2014, ACM SIGKDD EXPLOR NE, DOI DOI 10.1145/2594473.2594476
[2]   AutoML: state of the art with a focus on anomaly detection, challenges, and research directions [J].
Bahri, Maroua ;
Salutari, Flavia ;
Putina, Andrian ;
Sozio, Mauro .
INTERNATIONAL JOURNAL OF DATA SCIENCE AND ANALYTICS, 2022, 14 (02) :113-126
[3]   Ranking learning algorithms: Using IBL and meta-learning on accuracy and time results [J].
Brazdil, PB ;
Soares, C ;
Da Costa, JP .
MACHINE LEARNING, 2003, 50 (03) :251-277
[4]   LOF: Identifying density-based local outliers [J].
Breunig, MM ;
Kriegel, HP ;
Ng, RT ;
Sander, J .
SIGMOD RECORD, 2000, 29 (02) :93-104
[5]   Model Selection for Anomaly Detection [J].
Burnaev, E. ;
Erofeev, P. ;
Smolyakov, D. .
EIGHTH INTERNATIONAL CONFERENCE ON MACHINE VISION (ICMV 2015), 2015, 9875
[6]  
Davis J., 2006, P 23 INT C MACH LEAR, P233, DOI DOI 10.1145/1143844.1143874
[7]   A comparative evaluation of outlier detection algorithms: Experiments and analyses [J].
Domingues, Remi ;
Filippone, Maurizio ;
Michiardi, Pietro ;
Zouaoui, Jihane .
PATTERN RECOGNITION, 2018, 74 :406-421
[8]  
Dua D, 2017, UCI machine learning repository
[9]  
Elshawi R., 2019, Automated machine learning: State-of-the-art and open challenges
[10]  
Emmott A, 2016, Arxiv, DOI arXiv:1503.01158