Event-Based Update of Synapses in Voltage-Based Learning Rules

被引:2
作者
Stapmanns, Jonas [1 ,2 ]
Hahne, Jan [3 ]
Helias, Moritz [1 ,2 ]
Bolten, Matthias [3 ]
Diesmann, Markus [1 ,4 ,5 ]
Dahmen, David [1 ]
机构
[1] Julich Res Ctr, Inst Adv Simulat IAS 6, Inst Neurosci & Med INM 6, JARA Inst Brain Struct Funct Relationship INM 10, Julich, Germany
[2] Rhein Westfal TH Aachen, Inst Theoret Solid State Phys, Dept Phys, Aachen, Germany
[3] Berg Univ Wuppertal, Sch Math & Nat Sci, Wuppertal, Germany
[4] Rhein Westfal TH Aachen, Fac 1, Dept Phys, Aachen, Germany
[5] Rhein Westfal TH Aachen, Med Fac, Dept Psychiat Psychotherapy & Psychosomat, Aachen, Germany
关键词
event-based simulation; voltage-based plasticity rules; spiking neural network simulator; NEST; Clopath rule; Urbanczik-Senn rule; NETWORK SIMULATION; NEURAL-NETWORK; SPIKING; CONNECTIVITY; PLASTICITY; NEURONS; MODELS; INTEGRATION; PROCESSORS; FRAMEWORK;
D O I
10.3389/fninf.2021.609147
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
Due to the point-like nature of neuronal spiking, efficient neural network simulators often employ event-based simulation schemes for synapses. Yet many types of synaptic plasticity rely on the membrane potential of the postsynaptic cell as a third factor in addition to pre- and postsynaptic spike times. In some learning rules membrane potentials not only influence synaptic weight changes at the time points of spike events but in a continuous manner. In these cases, synapses therefore require information on the full time course of membrane potentials to update their strength which a priori suggests a continuous update in a time-driven manner. The latter hinders scaling of simulations to realistic cortical network sizes and relevant time scales for learning. Here, we derive two efficient algorithms for archiving postsynaptic membrane potentials, both compatible with modern simulation engines based on event-based synapse updates. We theoretically contrast the two algorithms with a time-driven synapse update scheme to analyze advantages in terms of memory and computations. We further present a reference implementation in the spiking neural network simulator NEST for two prototypical voltage-based plasticity rules: the Clopath rule and the Urbanczik-Senn rule. For both rules, the two event-based algorithms significantly outperform the time-driven scheme. Depending on the amount of data to be stored for plasticity, which heavily differs between the rules, a strong performance increase can be achieved by compressing or sampling of information on membrane potentials. Our results on computational efficiency related to archiving of information provide guidelines for the design of learning rules in order to make them practically usable in large-scale networks.
引用
收藏
页数:25
相关论文
共 50 条
[21]   Event-based rainfall analysis in Sinai, Egypt [J].
Gado, Tamer A. ;
Elkollaly, Mohamed ;
Guo, Yiping ;
El-Hagrsy, Rufayda M. ;
Mohameden, Mahmoud B. ;
Shalaby, Basma A. ;
Elboshy, Bahaa ;
Omara, Hewida ;
Elsawwaf, Mostafa A. .
HYDROLOGICAL SCIENCES JOURNAL, 2024, 69 (05) :622-638
[22]   Life event-based marketing using AI [J].
De Caigny, Arno ;
Coussement, Kristof ;
Hoornaert, Steven ;
Meire, Matthijs .
JOURNAL OF BUSINESS RESEARCH, 2025, 193
[23]   Go ahead and do not forget: Modular lifelong learning from event-based data [J].
Gryshchuk, Vadym ;
Weber, Cornelius ;
Loo, Chu Kiong ;
Wermter, Stefan .
NEUROCOMPUTING, 2022, 500 :1063-1074
[24]   Knowledge-enhanced deep reinforcement learning for intelligent event-based load shedding [J].
Hu, Ze ;
Shi, Zhongtuo ;
Zeng, Lingkang ;
Yao, Wei ;
Tang, Yong ;
Wen, Jinyu .
INTERNATIONAL JOURNAL OF ELECTRICAL POWER & ENERGY SYSTEMS, 2023, 148
[25]   Event-based Extraction of Navigation Features from Unsupervised Learning of Optic Flow Patterns [J].
Fricker, Paul ;
Chauhan, Tushar ;
Hurter, Christophe ;
Cottereau, Benoit .
PROCEEDINGS OF THE 17TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS (VISAPP), VOL 5, 2022, :702-710
[26]   Neuromorphic Near-Sensor Computing: From Event-Based Sensing to Edge Learning [J].
Safa, Ali ;
Van Assche, Jonah ;
Alea, Mark Daniel ;
Catthoor, Francky ;
Gielen, Georges G. E. .
IEEE MICRO, 2022, 42 (06) :88-95
[27]   Decentralized Triggering and Event-Based Integral Reinforcement Learning for Multiplayer Differential Game Systems [J].
Mu, Chaoxu ;
Wang, Ke ;
Zhu, Song ;
Cai, Guangbin .
IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2024, :3727-3741
[28]   Event-based parareal: A data-flow based implementation of parareal [J].
Berry, L. A. ;
Elwasif, W. ;
Reynolds-Barredo, J. M. ;
Samaddar, D. ;
Sanchez, R. ;
Newman, D. E. .
JOURNAL OF COMPUTATIONAL PHYSICS, 2012, 231 (17) :5945-5954
[29]   Event-Based Computation for Touch Localization Based on Precise Spike Timing [J].
Haessig, Germain ;
Milde, Moritz B. ;
Aceituno, Pau Vilimelis ;
Oubari, Omar ;
Knight, James C. ;
van Schaik, Andre ;
Benosman, Ryad B. ;
Indiveri, Giacomo .
FRONTIERS IN NEUROSCIENCE, 2020, 14
[30]   Event-Based Angular Velocity Regression with Spiking Networks [J].
Gehrig, Mathias ;
Shrestha, Sumit Bam ;
Mouritzen, Daniel ;
Scaramuzza, Davide .
2020 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2020, :4195-4202