SpikingJelly: An open-source machine learning infrastructure platform for spike-based intelligence

被引:159
作者
Fang, Wei [1 ,2 ,3 ]
Chen, Yanqi [1 ,2 ]
Ding, Jianhao [1 ]
Yu, Zhaofei [4 ]
Masquelier, Timothee [5 ]
Chen, Ding [2 ,6 ]
Huang, Liwei [1 ,2 ]
Zhou, Huihui [2 ]
Li, Guoqi [7 ,8 ]
Tian, Yonghong [1 ,2 ,3 ]
机构
[1] Peking Univ, Sch Comp Sci, Beijing, Peoples R China
[2] Peng Cheng Lab, Shenzhen, Peoples R China
[3] Peking Univ, Sch Elect & Comp Engn, Shenzhen Grad Sch, Beijing, Peoples R China
[4] Peking Univ, Inst Artificial Intelligence, Beijing, Peoples R China
[5] Univ Toulouse 3, Ctr Rech Cerveau & Cognit CERCO, CNRS, UMR5549, Toulouse, France
[6] Shanghai Jiao Tong Univ, Dept Comp Sci & Engn, Shanghai, Peoples R China
[7] Chinese Acad Sci, Inst Automat, Beijing, Peoples R China
[8] Univ Chinese Acad Sci, Sch Artificial Intelligence, Beijing, Peoples R China
基金
中国国家自然科学基金; 北京市自然科学基金;
关键词
DEEP NEURAL-NETWORKS; CLASSIFICATION; BACKPROPAGATION; ACCURATE; NEURONS; MODEL;
D O I
10.1126/sciadv.adi1480
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Spiking neural networks (SNNs) aim to realize brain-inspired intelligence on neuromorphic chips with high energy efficiency by introducing neural dynamics and spike properties. As the emerging spiking deep learning paradigm attracts increasing interest, traditional programming frameworks cannot meet the demands of the automatic differentiation, parallel computation acceleration, and high integration of processing neuromorphic datasets and deployment. In this work, we present the SpikingJelly framework to address the aforementioned dilemma. We contribute a full-stack toolkit for preprocessing neuromorphic datasets, building deep SNNs, optimizing their parameters, and deploying SNNs on neuromorphic chips. Compared to existing methods, the training of deep SNNs can be accelerated 11x, and the superior extensibility and flexibility of SpikingJelly enable users to accelerate custom models at low costs through multilevel inheritance and semiautomatic code generation. SpikingJelly paves the way for synthesizing truly energy-efficient SNN-based machine intelligence systems, which will enrich the ecology of neuromorphic computing.
引用
收藏
页数:18
相关论文
共 189 条
[71]  
Hu Y., 2018, ARXIV, DOI DOI 10.48550/ARXIV.1805.01352
[72]  
Huang LW, 2023, AAAI CONF ARTIF INTE, P31
[73]  
Hunsberger E., 2015, ARXIV, DOI DOI 10.48550/ARXIV.1510.08829
[74]   Is Neuromorphic MNIST Neuromorphic? Analyzing the Discriminative Power of Neuromorphic Datasets in the Time Domain [J].
Iyer, Laxmi R. ;
Chua, Yansong ;
Li, Haizhou .
FRONTIERS IN NEUROSCIENCE, 2021, 15
[75]   Simple model of spiking neurons [J].
Izhikevich, EM .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 2003, 14 (06) :1569-1572
[76]   Synaptic Plasticity Dynamics for Deep Continuous Local Learning (DECOLLE) [J].
Kaiser, Jacques ;
Mostafa, Hesham ;
Neftci, Emre .
FRONTIERS IN NEUROSCIENCE, 2020, 14
[77]  
Kaiser M. A.-A., 2023, ARXIV, DOI DOI 10.48550/ARXIV.2301.09111
[78]   Spiking Neural Networks Trained via Proxy [J].
Kheradpisheh, Saeed Reza ;
Mirsadeghi, Maryam ;
Masquelier, Timothee .
IEEE ACCESS, 2022, 10 :70769-70778
[79]   STDP-based spiking deep convolutional neural networks for object recognition [J].
Kheradpisheh, Saeed Reza ;
Ganjtabesh, Mohammad ;
Thorpe, Simon J. ;
Masquelier, Timothee .
NEURAL NETWORKS, 2018, 99 :56-67
[80]   Deep neural networks with weighted spikes [J].
Kim, Jaehyun ;
Kim, Heesu ;
Huh, Subin ;
Lee, Jinho ;
Choi, Kiyoung .
NEUROCOMPUTING, 2018, 311 :373-386