Benchmark and Survey of Automated Machine Learning Frameworks

被引:0
作者
Zöller M.-A. [1 ]
Huber M.F. [2 ,3 ]
机构
[1] USU Software AG, Rüppurrer Str. 1, Karlsruhe
[2] Institute of Industrial Manufacturing and Management IFF, University of Stuttgart, Allmandring 25, Stuttgart
[3] Fraunhofer Institute for Manufacturing Engineering and Automation IPA, Nobelstr. 12, Stuttgart
关键词
Machine learning;
D O I
10.1613/JAIR.1.11854
中图分类号
学科分类号
摘要
Machine learning (ML) has become a vital part in many aspects of our daily life. However, building well performing machine learning applications requires highly specialized data scientists and domain experts. Automated machine learning (AutoML) aims to reduce the demand for data scientists by enabling domain experts to build machine learning applications automatically without extensive knowledge of statistics and machine learning. This paper is a combination of a survey on current AutoML methods and a benchmark of popular AutoML frameworks on real data sets. Driven by the selected frameworks for evaluation, we summarize and review important AutoML techniques and methods concerning every step in building an ML pipeline. The selected AutoML frameworks are evaluated on 137 data sets from established AutoML benchmark suites. ©2021 AI Access Foundation. All rights reserved.
引用
收藏
页码:409 / 472
页数:63
相关论文
共 208 条
[1]  
Alaa A. M., Van Der Schaar M., AutoPrognosis: Automated Clinical Prognostic Modeling via Bayesian Optimization with Structured Kernel Learning, International Conference on Machine Learning, 1, pp. 139-148, (2018)
[2]  
Alia S., Smith-Miles K. A., A meta-learning approach to automatic kernel selection for support vector machines, Neurocomputing, 70, 1-3, pp. 173-186, (2006)
[3]  
Anderson R. L., Recent Advances in Finding Best Operating Conditions, Journal of the American Statistical Association, 48, 264, pp. 789-798, (1953)
[4]  
Ayria P., A complete Machine Learning PipeLine, (2018)
[5]  
EZDL, (2018)
[6]  
Balaji A., Allen A., Benchmarking Automatic Machine Learning Frameworks, (2018)
[7]  
Banzhaf W., Nordin P., Keller R. E., Francone F. D., Genetic Programming: An Introduction, (1997)
[8]  
Belotti P., Kirches C., Leyffer S., Linderoth J., Luedtke J., Mahajan A., Mixed-integer nonlinear optimization, Acta Numerica, 22, pp. 1-131, (2013)
[9]  
Bengio Y., Courville A., Vincent P., Representation Learning: A Review and New Perspectives, IEEE Transactions on Pattern Analysis and Machine Intelligence, 35, 8, pp. 1798-1828, (2013)
[10]  
Bergstra J., Bardenet R., Bengio Y., Kegl B., Algorithms for Hyper-Parameter Optimization, International Conference on Neural Information Processing Systems, pp. 2546-2554, (2011)