EvoDeep: A new evolutionary approach for automatic Deep Neural Networks parametrisation

被引:71
作者
Martin, Alejandro [1 ]
Lara-Cabrera, Raul [1 ]
Fuentes-Hurtado, Felix [2 ]
Naranjo, Valery [2 ]
Camacho, David [1 ]
机构
[1] Univ Autonoma Madrid, Comp Sci Dept, Madrid, Spain
[2] Univ Politecn Valencia, Inst Invest & Innovac Bioingn, Valencia, Spain
关键词
Deep Learning; Evolutionary Algorithms; Finite-State Machines; Automated parametrisation; BELIEF NETWORK; SYSTEM;
D O I
10.1016/j.jpdc.2017.09.006
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Deep Neural Networks (DNN) have become a powerful, and extremely popular mechanism, which has been widely used to solve problems of varied complexity, due to their ability to make models fitted to non-linear complex problems. Despite its well-known benefits, DNNs are complex learning models whose parametrisation and architecture are made usually by hand. This paper proposes a new Evolutionary Algorithm, named EvoDeep. devoted to evolve the parameters and the architecture of a DNN in order to maximise its classification accuracy, as well as maintaining a valid sequence of layers. This model is tested against a widely used dataset of handwritten digits images. The experiments performed using this dataset show that the Evolutionary Algorithm is able to select the parameters and the DNN architecture appropriately, achieving a 98.93% accuracy in the best run. (C) 2017 Elsevier Inc. All rights reserved.
引用
收藏
页码:180 / 191
页数:12
相关论文
共 43 条
[1]   Meta learning evolutionary artificial neural networks [J].
Abraham, A .
NEUROCOMPUTING, 2004, 56 (1-4) :1-38
[2]  
[Anonymous], TENSORFLOW LARGE SCA
[3]  
[Anonymous], 2014, ADV NEURAL INFORM PR
[4]  
[Anonymous], ARXIV160304467
[5]  
[Anonymous], PROC CVPR IEEE
[6]  
[Anonymous], IEEE T NEURAL NETW L
[7]  
[Anonymous], 2016, PROC INT S INTELL DI
[8]  
[Anonymous], 2016, DEEP LEARNING
[9]  
[Anonymous], 2015, IEEE I CONF COMP VIS, DOI DOI 10.1109/ICCV.2015.123
[10]  
[Anonymous], 2016, TSINGHUA SCI TECHNOL