SpikingJelly: An open-source machine learning infrastructure platform for spike-based intelligence

被引:93
作者
Fang, Wei [1 ,2 ,3 ]
Chen, Yanqi [1 ,2 ]
Ding, Jianhao [1 ]
Yu, Zhaofei [4 ]
Masquelier, Timothee [5 ]
Chen, Ding [2 ,6 ]
Huang, Liwei [1 ,2 ]
Zhou, Huihui [2 ]
Li, Guoqi [7 ,8 ]
Tian, Yonghong [1 ,2 ,3 ]
机构
[1] Peking Univ, Sch Comp Sci, Beijing, Peoples R China
[2] Peng Cheng Lab, Shenzhen, Peoples R China
[3] Peking Univ, Sch Elect & Comp Engn, Shenzhen Grad Sch, Beijing, Peoples R China
[4] Peking Univ, Inst Artificial Intelligence, Beijing, Peoples R China
[5] Univ Toulouse 3, Ctr Rech Cerveau & Cognit CERCO, CNRS, UMR5549, Toulouse, France
[6] Shanghai Jiao Tong Univ, Dept Comp Sci & Engn, Shanghai, Peoples R China
[7] Chinese Acad Sci, Inst Automation, Beijing, Peoples R China
[8] Univ Chinese Acad Sci, Sch Artificial Intelligence, Beijing, Peoples R China
来源
SCIENCE ADVANCES | 2023年 / 9卷 / 40期
基金
中国国家自然科学基金; 北京市自然科学基金;
关键词
DEEP NEURAL-NETWORKS; CLASSIFICATION; BACKPROPAGATION; ACCURATE; NEURONS;
D O I
10.1126/sciadv.adi1480
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Spiking neural networks (SNNs) aim to realize brain-inspired intelligence on neuromorphic chips with high energy efficiency by introducing neural dynamics and spike properties. As the emerging spiking deep learning paradigm attracts increasing interest, traditional programming frameworks cannot meet the demands of the automatic differentiation, parallel computation acceleration, and high integration of processing neuromorphic datasets and deployment. In this work, we present the SpikingJelly framework to address the aforementioned dilemma. We contribute a full-stack toolkit for preprocessing neuromorphic datasets, building deep SNNs, optimizing their parameters, and deploying SNNs on neuromorphic chips. Compared to existing methods, the training of deep SNNs can be accelerated 11x, and the superior extensibility and flexibility of SpikingJelly enable users to accelerate custom models at low costs through multilevel inheritance and semiautomatic code generation. SpikingJelly paves the way for synthesizing truly energy-efficient SNN-based machine intelligence systems, which will enrich the ecology of neuromorphic computing.
引用
收藏
页数:18
相关论文
共 190 条
  • [71] Huang LW, 2023, AAAI CONF ARTIF INTE, P31
  • [72] Hunsberger E, 2015, Arxiv, DOI arXiv:1510.08829
  • [73] Is Neuromorphic MNIST Neuromorphic? Analyzing the Discriminative Power of Neuromorphic Datasets in the Time Domain
    Iyer, Laxmi R.
    Chua, Yansong
    Li, Haizhou
    [J]. FRONTIERS IN NEUROSCIENCE, 2021, 15
  • [74] Simple model of spiking neurons
    Izhikevich, EM
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS, 2003, 14 (06): : 1569 - 1572
  • [75] Jin C.Jin, 2022, arXiv
  • [76] Synaptic Plasticity Dynamics for Deep Continuous Local Learning (DECOLLE)
    Kaiser, Jacques
    Mostafa, Hesham
    Neftci, Emre
    [J]. FRONTIERS IN NEUROSCIENCE, 2020, 14
  • [77] Kaiser M. A.-A., 2023, arXiv, DOI 10.48550/arXiv.2301.09111
  • [78] Spiking Neural Networks Trained via Proxy
    Kheradpisheh, Saeed Reza
    Mirsadeghi, Maryam
    Masquelier, Timothee
    [J]. IEEE ACCESS, 2022, 10 : 70769 - 70778
  • [79] STDP-based spiking deep convolutional neural networks for object recognition
    Kheradpisheh, Saeed Reza
    Ganjtabesh, Mohammad
    Thorpe, Simon J.
    Masquelier, Timothee
    [J]. NEURAL NETWORKS, 2018, 99 : 56 - 67
  • [80] Deep neural networks with weighted spikes
    Kim, Jaehyun
    Kim, Heesu
    Huh, Subin
    Lee, Jinho
    Choi, Kiyoung
    [J]. NEUROCOMPUTING, 2018, 311 : 373 - 386