A new genetic algorithm based evolutionary neural architecture search for image classification

被引:0
作者
Wen, Long [1 ]
Gao, Liang [2 ]
Li, Xinyu [2 ]
Li, Hui [3 ]
机构
[1] China Univ Geosci, Sch Mech Engn & Elect Informat, 388 Lumo Rd, Wuhan 430074, Peoples R China
[2] Huazhong Univ Sci & Technol, State Key Lab Digital Mfg Equipment & Technol, 1037 Luoyu Rd, Wuhan 430074, Peoples R China
[3] Wuhan Univ, Inst Technol Sci, Sch Power & Mech Engn, Wuhan 430072, Peoples R China
基金
国家重点研发计划;
关键词
Neural Architecture Search; Genetic Algorithm; Deep Learning; Image Classification;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Deep Learning (DL) has achieved the great breakthrough in image classification. As DL structure is problemdependent and it has the crucial impact on its performance, it is still necessary to re-design the structures of DL according to the actual needs, even there exists various benchmark DL structures. Neural Architecture Search (NAS) which can design the DL network automatically has been widely investigated. However, many NAS methods suffer from the huge computation time. To overcome this drawback, this research proposed a new Evolutionary Neural Architecture Search with RepVGG nodes (EvoNAS-Rep). Firstly, a new encoding strategy is developed, which can map the fixed-length encoding individual to DL structure with variable depth using RepVGG nodes. Secondly, Genetic Algorithm (GA) is adopted for searching the optimal individual and its corresponding DL model. Thirdly, the iterative training process is designed to train the DL model and to evolve the GA simultaneously. The proposed EvoNAS-Rep is validated on the famous CIFAR 10 and CIFAR 100. The results show that EvoNAS-Rep has obtained 96.35% and 79.82% with only near 0.2 GPU days, which is both effectiveness and efficiency. EvoNAS-Rep is also validated on two real-world applications, including the NEU-CLS and the Chest XRay 2017 datasets, and the results show that EvoNAS-Rep has achieved the competitive results.
引用
收藏
页数:9
相关论文
共 43 条
[1]  
Barret Zoph, 2017, Arxiv, DOI arXiv:1611.01578
[2]  
Bowen Baker, 2017, Arxiv, DOI arXiv:1611.02167
[3]   Unsupervised domain-share CNN for machine fault transfer diagnosis from steady speeds to time-varying speeds [J].
Cao, Hongru ;
Shao, Haidong ;
Zhong, Xiang ;
Deng, Qianwang ;
Yang, Xingkai ;
Xuan, Jianping .
JOURNAL OF MANUFACTURING SYSTEMS, 2022, 62 :186-198
[4]  
Elsken T., 2019, INT C LEARNING REPRE
[5]   Automatic Searching and Pruning of Deep Neural Networks for Medical Imaging Diagnostic [J].
Fernandes Jr, Francisco Erivaldo ;
Yen, Gary G. .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2021, 32 (12) :5664-5674
[6]   Particle swarm optimization of deep neural networks architectures for image classification [J].
Fernandes Junior, Francisco Erivaldo ;
Yen, Gary G. .
SWARM AND EVOLUTIONARY COMPUTATION, 2019, 49 :62-74
[7]   A deep-learning-based approach for fast and robust steel surface defects classification [J].
Fu, Guizhong ;
Sun, Peize ;
Zhu, Wenbin ;
Yang, Jiangxin ;
Cao, Yanlong ;
Yang, Michael Ying ;
Cao, Yanpeng .
OPTICS AND LASERS IN ENGINEERING, 2019, 121 :397-405
[8]   A Multilevel Information Fusion-Based Deep Learning Method for Vision-Based Defect Recognition [J].
Gao, Yiping ;
Gao, Liang ;
Li, Xinyu ;
Wang, Xi Vincent .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2020, 69 (07) :3980-3991
[9]   Efficient evolutionary neural architecture search by modular inheritable crossover [J].
He, Cheng ;
Tan, Hao ;
Huang, Shihua ;
Cheng, Ran .
SWARM AND EVOLUTIONARY COMPUTATION, 2021, 64
[10]   Simple-Encoded evolving convolutional neural network and its application to skin disease image classification [J].
He, Xiaoyu ;
Wang, Yong ;
Wang, Xiaojing ;
Huang, Weihong ;
Zhao, Shuang ;
Chen, Xiang .
SWARM AND EVOLUTIONARY COMPUTATION, 2021, 67