Towards Automated Machine Learning: Evaluation and Comparison of AutoML Approaches and Tools

被引:140
作者
Anh Truong [1 ]
Walters, Austin [1 ]
Goodsitt, Jeremy [1 ]
Hines, Keegan [1 ]
Bruss, C. Bayan [1 ]
Farivar, Reza [1 ,2 ]
机构
[1] Capital One, Appl Res, Ctr Machine Learning, Mclean, VA 22102 USA
[2] Univ Illinois, Dept Comp Sci, 1304 W Springfield Ave, Urbana, IL 61801 USA
来源
2019 IEEE 31ST INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE (ICTAI 2019) | 2019年
关键词
AutoML; automated machine learning; driverless AI; model selection; hyperparameter optimization;
D O I
10.1109/ICTAI.2019.00209
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
There has been considerable growth and interest in industrial applications of machine learning (ML) in recent years. ML engineers, as a consequence, are in high demand across the industry, yet improving the efficiency of ML engineers remains a fundamental challenge. Automated machine learning (AutoML) has emerged as a way to save time and effort on repetitive tasks in ML pipelines, such as data pre-processing, feature engineering, model selection, hyperparameter optimization, and prediction result analysis. In this paper, we investigate the current state of AutoML tools aiming to automate these tasks. We conduct various evaluations of the tools on many datasets, in different data segments, to examine their performance, and compare their advantages and disadvantages on different test cases.
引用
收藏
页码:1471 / 1479
页数:9
相关论文
共 9 条
[1]  
[Anonymous], 2009, ACM SIGKDD explorations newsletter, DOI 10.1145/1656274.1656278
[2]  
[Anonymous], 2018, Auto-Keras: An Efficient Neural Architecture Search System
[3]  
[Anonymous], 2015, NIPS
[4]  
Hutter Frank, 2011, Learning and Intelligent Optimization. 5th International Conference, LION 5. Selected Papers, P507, DOI 10.1007/978-3-642-25566-3_40
[5]  
Kotthoff L, 2017, J MACH LEARN RES, V18
[6]   Evaluation of a Tree-based Pipeline Optimization Tool for Automating Data Science [J].
Olson, Randal S. ;
Bartley, Nathan ;
Urbanowicz, Ryan J. ;
Moore, Jason H. .
GECCO'16: PROCEEDINGS OF THE 2016 GENETIC AND EVOLUTIONARY COMPUTATION CONFERENCE, 2016, :485-492
[7]  
Pham H., 2018, PROC 35 INT C MACH L
[8]  
Vanschoren Joaquin, 2013, ACM SIGKDD Explorations Newsletter, V15, P49, DOI [DOI 10.1145/2641190.2641198, 10.1145/2641190.2641198]
[9]  
Zoph B., 2017, P 5 INT C LEARN REPR