Event-Based Update of Synapses in Voltage-Based Learning Rules

被引:2
|
作者
Stapmanns, Jonas [1 ,2 ]
Hahne, Jan [3 ]
Helias, Moritz [1 ,2 ]
Bolten, Matthias [3 ]
Diesmann, Markus [1 ,4 ,5 ]
Dahmen, David [1 ]
机构
[1] Julich Res Ctr, Inst Adv Simulat IAS 6, Inst Neurosci & Med INM 6, JARA Inst Brain Struct Funct Relationship INM 10, Julich, Germany
[2] Rhein Westfal TH Aachen, Inst Theoret Solid State Phys, Dept Phys, Aachen, Germany
[3] Berg Univ Wuppertal, Sch Math & Nat Sci, Wuppertal, Germany
[4] Rhein Westfal TH Aachen, Fac 1, Dept Phys, Aachen, Germany
[5] Rhein Westfal TH Aachen, Med Fac, Dept Psychiat Psychotherapy & Psychosomat, Aachen, Germany
关键词
event-based simulation; voltage-based plasticity rules; spiking neural network simulator; NEST; Clopath rule; Urbanczik-Senn rule; NETWORK SIMULATION; NEURAL-NETWORK; SPIKING; CONNECTIVITY; PLASTICITY; NEURONS; MODELS; INTEGRATION; PROCESSORS; FRAMEWORK;
D O I
10.3389/fninf.2021.609147
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
Due to the point-like nature of neuronal spiking, efficient neural network simulators often employ event-based simulation schemes for synapses. Yet many types of synaptic plasticity rely on the membrane potential of the postsynaptic cell as a third factor in addition to pre- and postsynaptic spike times. In some learning rules membrane potentials not only influence synaptic weight changes at the time points of spike events but in a continuous manner. In these cases, synapses therefore require information on the full time course of membrane potentials to update their strength which a priori suggests a continuous update in a time-driven manner. The latter hinders scaling of simulations to realistic cortical network sizes and relevant time scales for learning. Here, we derive two efficient algorithms for archiving postsynaptic membrane potentials, both compatible with modern simulation engines based on event-based synapse updates. We theoretically contrast the two algorithms with a time-driven synapse update scheme to analyze advantages in terms of memory and computations. We further present a reference implementation in the spiking neural network simulator NEST for two prototypical voltage-based plasticity rules: the Clopath rule and the Urbanczik-Senn rule. For both rules, the two event-based algorithms significantly outperform the time-driven scheme. Depending on the amount of data to be stored for plasticity, which heavily differs between the rules, a strong performance increase can be achieved by compressing or sampling of information on membrane potentials. Our results on computational efficiency related to archiving of information provide guidelines for the design of learning rules in order to make them practically usable in large-scale networks.
引用
收藏
页数:25
相关论文
共 50 条
  • [1] Representation learning using event-based STDP
    Tavanaei, Amirhossein
    Masquelier, Timothee
    Maida, Anthony
    NEURAL NETWORKS, 2018, 105 : 294 - 303
  • [2] Spatiotemporal features for asynchronous event-based data
    Lagorce, Xavier
    Ieng, Sio-Hoi
    Clady, Xavier
    Pfeiffer, Michael
    Benosman, Ryad B.
    FRONTIERS IN NEUROSCIENCE, 2015, 9
  • [3] Event-Based Spiking Neural Networks for Object Detection: A Review of Datasets, Architectures, Learning Rules, and Implementation
    Iaboni, Craig
    Abichandani, Pramod
    IEEE ACCESS, 2024, 12 : 180532 - 180596
  • [4] EventMix: An efficient data augmentation strategy for event-based learning
    Shen, Guobin
    Zhao, Dongcheng
    Zeng, Yi
    INFORMATION SCIENCES, 2023, 644
  • [5] An Event-Based Neural Network Architecture With an Asynchronous Programmable Synaptic Memory
    Moradi, Saber
    Indiveri, Giacomo
    IEEE TRANSACTIONS ON BIOMEDICAL CIRCUITS AND SYSTEMS, 2014, 8 (01) : 98 - 107
  • [6] Event-Based, Timescale Invariant Unsupervised Online Deep Learning With STDP
    Thiele, Johannes C.
    Bichler, Olivier
    Dupret, Antoine
    FRONTIERS IN COMPUTATIONAL NEUROSCIENCE, 2018, 12
  • [7] Point process models for event-based speech recognition
    Jansen, Aren
    Niyogi, Partha
    SPEECH COMMUNICATION, 2009, 51 (12) : 1155 - 1168
  • [8] Fast event-based epidemiological simulations on national scales
    Bauer, Pavol
    Engblom, Stefan
    Widgren, Stefan
    INTERNATIONAL JOURNAL OF HIGH PERFORMANCE COMPUTING APPLICATIONS, 2016, 30 (04) : 438 - 453
  • [9] On event-based optical flow detection
    Brosch, Tobias
    Tschechne, Stephan
    Neumann, Heiko
    FRONTIERS IN NEUROSCIENCE, 2015, 9
  • [10] ELM solutions for event-based systems
    Tapson, Jonathan
    Cohen, Greg
    van Schaik, Andre
    NEUROCOMPUTING, 2015, 149 : 435 - 442