A review of neural architecture search

被引：64
作者：
Baymurzina, Dilyara [1 ]
Golikov, Eugene [1 ,3 ]
Burtsev, Mikhail [1 ,2 ]
机构：
[1] Moscow Inst Phys & Technol, Neural Networks & Deep Learning Lab, 9 Inst Skiy Lane, Dolgoprudnyi 141701, Moscow Region, Russia
[2] Artificial Intelligence Res Inst AIRI, Moscow, Russia
[3] Ecole Polytech Fed Lausanne, Route Cantonale, CH-1015 Lausanne, Vaud, Switzerland
来源：
NEUROCOMPUTING | 2022年 / 474卷
关键词：
Neural architecture search; NAS; AutoML; EVOLUTION; NETWORKS;
D O I：
10.1016/j.neucom.2021.12.014
中图分类号：
TP18 [人工智能理论];
学科分类号：
081104 ; 0812 ; 0835 ; 1405 ;
摘要：
Despite the impressive progress in neural network architecture design, improving the performance of the existing state-of-the-art models has become increasingly challenging. For this reason, the paradigm for neural architecture design is shifting from being expert-driven to almost fully automated. An emerging body of research related to such machine-aided design is called a Neural Architecture Search (NAS). This paper reviews the recent works on NAS and highlights several crucial concepts and problems of this field. (c) 2021 Elsevier B.V. All rights reserved.
引用
收藏
页码：82 / 93
页数：12
相关论文
共 86 条
  • [31] Klein A., 2019, ARXIV190504970
  • [32] Krizhevsky A., 2009, CITESEER
  • [33] Lakhman K, 2013, GECCO'13: PROCEEDINGS OF THE 2013 GENETIC AND EVOLUTIONARY COMPUTATION CONFERENCE, P703
  • [34] Lehman Joel, 2013, Scholarpedia, V8, P30977, DOI DOI 10.4249/SCHOLARPEDIA.30977
  • [35] Li L., 2020, PR MACH LEARN RES, P367
  • [36] Relation-Aware Graph Attention Network for Visual Question Answering
    Li, Linjie
    Gan, Zhe
    Cheng, Yu
    Liu, Jingjing
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 10312 - 10321
  • [37] Lin M., 2020, ARXIV200614090
  • [38] Progressive Neural Architecture Search
    Liu, Chenxi
    Zoph, Barret
    Neumann, Maxim
    Shlens, Jonathon
    Hua, Wei
    Li, Li-Jia
    Li Fei-Fei
    Yuille, Alan
    Huang, Jonathan
    Murphy, Kevin
    [J]. COMPUTER VISION - ECCV 2018, PT I, 2018, 11205 : 19 - 35
  • [39] Liu H, 2019, PROCEEDINGS OF THE THIRD INTERNATIONAL SYMPOSIUM - EDUCATIONAL RESEARCH AND EDUCATIONAL TECHNOLOGY, 2019, P3
  • [40] Lundberg SM, 2017, ADV NEUR IN, V30
123456789