SPANNER: A Self-Repairing Spiking Neural Network Hardware Architecture

被引:49
作者
Liu, Junxiu [1 ]
Harkin, Jim [2 ]
Maguire, Liam P. [2 ]
McDaid, Liam J. [2 ]
Wade, John J. [2 ]
机构
[1] Guangxi Normal Univ, Fac Elect Engn, Guangxi Key Lab Multisource Informat Min & Secur, Guilin 41004, Peoples R China
[2] Ulster Univ, Sch Comp & Intelligent Syst, Magee Campus, Derry BT48 7JL, North Ireland
基金
英国工程与自然科学研究理事会;
关键词
Astrocytes; electronic systems; fault tolerance; field-programmable gate array (FPGA); hardware; self-repair; spiking neural network (SNN); FAULT-TOLERANT DESIGN; DIGITAL IMPLEMENTATION; ASTROCYTE; MODEL;
D O I
10.1109/TNNLS.2017.2673021
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recent research has shown that a glial cell of astrocyte underpins a self-repair mechanism in the human brain, where spiking neurons provide direct and indirect feedbacks to presynaptic terminals. These feedbacks modulate the synaptic transmission probability of release (PR). When synaptic faults occur, the neuron becomes silent or near silent due to the low PR of synapses; whereby the PRs of remaining healthy synapses are then increased by the indirect feedback from the astrocyte cell. In this paper, a novel hardware architecture of Self-rePAiring spiking Neural NEtwoRk (SPANNER) is proposed, which mimics this self-repairing capability in the human brain. This paper demonstrates that the hardware can self-detect and self-repair synaptic faults without the conventional components for the fault detection and fault repairing. Experimental results show that SPANNER can maintain the system performance with fault densities of up to 40%, and more importantly SPANNER has only a 20% performance degradation when the self-repairing architecture is significantly damaged at a fault density of 80%.
引用
收藏
页码:1287 / 1300
页数:14
相关论文
共 54 条
[1]   True North: Design and Tool Flow of a 65 mW 1 Million Neuron Programmable Neurosynaptic Chip [J].
Akopyan, Filipp ;
Sawada, Jun ;
Cassidy, Andrew ;
Alvarez-Icaza, Rodrigo ;
Arthur, John ;
Merolla, Paul ;
Imam, Nabil ;
Nakamura, Yutaka ;
Datta, Pallab ;
Nam, Gi-Joon ;
Taba, Brian ;
Beakes, Michael ;
Brezzo, Bernard ;
Kuang, Jente B. ;
Manohar, Rajit ;
Risk, William P. ;
Jackson, Bryan ;
Modha, Dharmendra S. .
IEEE TRANSACTIONS ON COMPUTER-AIDED DESIGN OF INTEGRATED CIRCUITS AND SYSTEMS, 2015, 34 (10) :1537-1557
[2]  
[Anonymous], 2002, SPIKING NEURON MODEL
[3]   Tripartite synapses: glia, the unacknowledged partner [J].
Araque, A ;
Parpura, V ;
Sanzgiri, RP ;
Haydon, PG .
TRENDS IN NEUROSCIENCES, 1999, 22 (05) :208-215
[4]   Fault tolerance using dynamic reconfiguration on the POEtic tissue [J].
Barker, Will ;
Halliday, David M. ;
Thoma, Yann ;
Sanchez, Eduardo ;
Tempesti, Gianluca ;
Tyrrell, Andy M. .
IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION, 2007, 11 (05) :666-684
[5]   Neurogrid: A Mixed-Analog-Digital Multichip System for Large-Scale Neural Simulations [J].
Benjamin, Ben Varkey ;
Gao, Peiran ;
McQuinn, Emmett ;
Choudhary, Swadesh ;
Chandrasekaran, Anand R. ;
Bussat, Jean-Marie ;
Alvarez-Icaza, Rodrigo ;
Arthur, John V. ;
Merolla, Paul A. ;
Boahen, Kwabena .
PROCEEDINGS OF THE IEEE, 2014, 102 (05) :699-716
[6]   Scalable Hierarchical Network-on-Chip Architecture for Spiking Neural Network Hardware Implementations [J].
Carrillo, Snaider ;
Harkin, Jim ;
McDaid, Liam J. ;
Morgan, Fearghal ;
Pande, Sandeep ;
Cawley, Seamus ;
McGinley, Brian .
IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2013, 24 (12) :2451-2461
[7]   Advancing interconnect density for spiking neural network hardware implementations using traffic-aware adaptive network-on-chip routers [J].
Carrillo, Snaider ;
Harkin, Jim ;
McDaid, Liam ;
Pande, Sandeep ;
Cawley, Seamus ;
McGinley, Brian ;
Morgan, Fearghal .
NEURAL NETWORKS, 2012, 33 :42-57
[8]   Statistical timing analysis under spatial correlations [J].
Chang, HL ;
Sapatnekar, SS .
IEEE TRANSACTIONS ON COMPUTER-AIDED DESIGN OF INTEGRATED CIRCUITS AND SYSTEMS, 2005, 24 (09) :1467-1482
[9]   Emerging roles of astrocytes in neural circuit development [J].
Clarke, Laura E. ;
Barres, Ben A. .
NATURE REVIEWS NEUROSCIENCE, 2013, 14 (05) :311-321
[10]  
De Pitta M., 2015, NEUROSCIENCE, P1