Two-stage coevolution method for deep CNN: A case study in smart manufacturing

被引:0
作者
Qu, Yuanju [1 ]
Ma, Yue [1 ]
Ming, Xinguo [2 ]
Wang, Yangpeng [1 ]
Cheng, Shenghui [3 ]
Chu, Xianghua [1 ,4 ]
机构
[1] Shenzhen Univ, Coll Management, Shenzhen 518055, Peoples R China
[2] Shanghai Jiao Univ, Sch Mech Engn, Shanghai 201100, Peoples R China
[3] Westlake Univ, Sch Engn, Hangzhou 310024, Peoples R China
[4] Shenzhen Univ, Inst Big Data Intelligent Management & Decis, Shenzhen 518055, Peoples R China
基金
中国国家自然科学基金;
关键词
Two-stage coevolution; Deep CNN; PSO; GA; Smart manufacturing; NEURAL-NETWORKS; ALGORITHMS;
D O I
10.1016/j.asoc.2023.110026
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Smart manufacturing system is very complex and there are a lot of different types of data to deal with, which lead to the difficulty of usage. Frequently manually tuning hyperparameters and modifying the architecture of the network have become a major problem for participants, and it has seriously affected the application and promotion of Deep learning (DL) in industry. In order to solve this problem, a novel self-evolving deep CNN method: two-stage coevolution method (TSC) is proposed in this paper to automatically optimize the hyperparameters and effectively evolve the most suitable network by summarizing the characteristics of the excellent artificial architectures. The first stage is mainly to optimize the hyperparameters with Orthogonal experimental algorithm. The second stage is to produce the best deep CNN with the optimized hyperparameters through self-evolving computation. In the second stage, three well-known deep-CNN architectures are used as the initialization seeds and each seed is presented by a particle and a gene to coevolve the necessary factors for a deep CNN driven by particle swarm optimization (PSO) and genetic algorithm (GA). At last, a case study for smart manufacturing systems was carried out to demonstrate the effectiveness and convenience of the proposed method. And the TSC method was also compared with other two self-evolving methods. The experiment results show that TSC method is superior over other well-known algorithms.(c) 2023 Elsevier B.V. All rights reserved.
引用
收藏
页数:11
相关论文
共 30 条
  • [1] Artificial neural network development by means of a novel combination of grammatical evolution and genetic algorithm
    Ahmadizar, Fardin
    Soltanian, Khabat
    AkhlaghianTab, Fardin
    Tsoulos, Ioannis
    [J]. ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2015, 39 : 1 - 13
  • [2] [Anonymous], 1989, Genetic Algorithms in Search, Optimization, and Machine Learning
  • [3] [Anonymous], 2008, Journal of machine learning research
  • [4] Assuncao F., 2017, P 2017 GEN EV COMP C
  • [5] Assuno F., 2018, EVOLVING TOPOLOGY LA
  • [6] Bi Y, 2019, IEEE C EVOL COMPUTAT, P3197, DOI [10.1109/cec.2019.8790151, 10.1109/CEC.2019.8790151]
  • [7] A computationally efficient evolutionary algorithm for real-parameter optimization
    Deb, K
    Anand, A
    Joshi, D
    [J]. EVOLUTIONARY COMPUTATION, 2002, 10 (04) : 371 - 395
  • [8] Signal Model-Based Fault Detection and Diagnosis for Induction Motors Using Features of Vibration Signal in Two-Dimension Domain
    Do, Van Tuan
    Chong, Ui-Pil
    [J]. STROJNISKI VESTNIK-JOURNAL OF MECHANICAL ENGINEERING, 2011, 57 (09): : 655 - 666
  • [9] Essien A.E., 2020, IEEE T IND INFORM, VPP, P1
  • [10] An Overview of Deep Learning Algorithms and Their Applications in Neuropsychiatry
    Guney, Gokhan
    Yigin, Busra Ozgode
    Guven, Necdet
    Alici, Yasemin Hosgoren
    Colak, Burcin
    Erzin, Gamze
    Saygili, Gorkem
    [J]. CLINICAL PSYCHOPHARMACOLOGY AND NEUROSCIENCE, 2021, 19 (02) : 206 - 219