Structural Analysis of Sparse Neural Networks

被引:12
作者
Stier, Julian [1 ]
Granitzer, Michael [1 ]
机构
[1] Univ Passau, Innstr 42, D-94032 Passau, Germany
来源
KNOWLEDGE-BASED AND INTELLIGENT INFORMATION & ENGINEERING SYSTEMS (KES 2019) | 2019年 / 159卷
关键词
artificial neural networks; sparse network structures; small-world neural networks; scale-free; architecture performance estimation; DYNAMICS;
D O I
10.1016/j.procs.2019.09.165
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Sparse Neural Networks regained attention due to their potential of mathematical and computational advantages. We give motivation to study Artificial Neural Networks (ANNs) from a network science perspective, provide a technique to embed arbitrary Directed Acyclic Graphs into ANNs and report study results on predicting the performance of image classifiers based on the structural properties of the networks' underlying graph. Results could further progress neuroevolution and add explanations for the success of distinct architectures from a structural perspective. (C) 2019 The Authors. Published by Elsevier B.V.
引用
收藏
页码:107 / 116
页数:10
相关论文
共 25 条
  • [1] Statistical mechanics of complex networks
    Albert, R
    Barabási, AL
    [J]. REVIEWS OF MODERN PHYSICS, 2002, 74 (01) : 47 - 97
  • [2] ON THE MAXIMAL NUMBER OF STRONGLY INDEPENDENT VERTICES IN A RANDOM ACYCLIC DIRECTED GRAPH
    BARAK, AB
    ERDOS, P
    [J]. SIAM JOURNAL ON ALGEBRAIC AND DISCRETE METHODS, 1984, 5 (04): : 508 - 514
  • [3] Boski M, 2017, 2017 10TH INTERNATIONAL WORKSHOP ON MULTIDIMENSIONAL (ND) SYSTEMS (NDS)
  • [4] Bourely Alfred, 2017, ARXIVCSLG170605683
  • [5] Domhan T, 2015, PROCEEDINGS OF THE TWENTY-FOURTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE (IJCAI), P3460
  • [6] ERDOS P, 1960, B INT STATIST INST, V38, P343
  • [7] Glorot X., 2011, P 14 INT C ART INT S, P315
  • [8] Graves A, 2012, STUD COMPUT INTELL, V385, P1, DOI [10.1162/neco.1997.9.1.1, 10.1007/978-3-642-24797-2]
  • [9] He K., 2016, IEEE C COMPUT VIS PA, DOI [10.1007/978-3-319-46493-0_38, DOI 10.1007/978-3-319-46493-0_38, DOI 10.1109/CVPR.2016.90]
  • [10] Is the brain really a small-world network?
    Hilgetag, Claus C.
    Goulas, Alexandros
    [J]. BRAIN STRUCTURE & FUNCTION, 2016, 221 (04) : 2361 - 2366