Structural Analysis of Sparse Neural Networks

被引:12
作者
Stier, Julian [1 ]
Granitzer, Michael [1 ]
机构
[1] Univ Passau, Innstr 42, D-94032 Passau, Germany
来源
KNOWLEDGE-BASED AND INTELLIGENT INFORMATION & ENGINEERING SYSTEMS (KES 2019) | 2019年 / 159卷
关键词
artificial neural networks; sparse network structures; small-world neural networks; scale-free; architecture performance estimation; DYNAMICS;
D O I
10.1016/j.procs.2019.09.165
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Sparse Neural Networks regained attention due to their potential of mathematical and computational advantages. We give motivation to study Artificial Neural Networks (ANNs) from a network science perspective, provide a technique to embed arbitrary Directed Acyclic Graphs into ANNs and report study results on predicting the performance of image classifiers based on the structural properties of the networks' underlying graph. Results could further progress neuroevolution and add explanations for the success of distinct architectures from a structural perspective. (C) 2019 The Authors. Published by Elsevier B.V.
引用
收藏
页码:107 / 116
页数:10
相关论文
共 25 条
  • [21] Pedregosa F, 2011, J MACH LEARN RES, V12, P2825
  • [22] Training Sparse Neural Networks
    Srinivas, Suraj
    Subramanya, Akshayvarun
    Babu, R. Venkatesh
    [J]. 2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2017, : 455 - 462
  • [23] Srivastava R. K., 2015, ARXIV150500387, P1
  • [24] Analysing Neural Network Topologies: a Game Theoretic Approach
    Stier, Julian
    Gianini, Gabriele
    Granitzer, Michael
    Ziegler, Konstantin
    [J]. KNOWLEDGE-BASED AND INTELLIGENT INFORMATION & ENGINEERING SYSTEMS (KES-2018), 2018, 126 : 234 - 243
  • [25] Collective dynamics of 'small-world' networks
    Watts, DJ
    Strogatz, SH
    [J]. NATURE, 1998, 393 (6684) : 440 - 442