Incremental Neural Synthesis for Spiking Neural Networks

被引:2
作者
Huy Le Nguyen [1 ]
Chu, Dominique [1 ]
机构
[1] Univ Kent, Sch Comp, Canterbury, Kent, England
来源
2022 IEEE SYMPOSIUM SERIES ON COMPUTATIONAL INTELLIGENCE (SSCI) | 2022年
关键词
Convolutional Spiking Neural Networks; Neural Synthesis; Incremental Learning; Multi-Spike Learning; NEURONS; TEMPOTRON; MACHINE;
D O I
10.1109/SSCI51031.2022.10022275
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We present an iterative neural synthesis approach to train Convolutional Spiking Neural Networks for classification problems. Unlike previous neural synthesis methods which primarily compute the neuron firing rates, our method is designed to compute multiple spikes at arbitrary timings. As such, our approach is directly applicable to spatio-temporal problems using spiking network models. In our approach, each weight update is formulated as a linear Constraint Satisfaction Problem, which can then be solved using existing numerical techniques. On the MNIST, EMNIST, and ETH-80 image classification benchmarks, our approach demonstrates competitive with other models in the literature, while requiring relatively few training samples to converge to a good solution.
引用
收藏
页码:649 / 656
页数:8
相关论文
共 62 条
[31]   Evaluating the Energy Efficiency of Deep Convolutional Neural Networks on CPUs and GPUs [J].
Li, Da ;
Chen, Xinbo ;
Becchi, Michela ;
Zong, Ziliang .
PROCEEDINGS OF 2016 IEEE INTERNATIONAL CONFERENCES ON BIG DATA AND CLOUD COMPUTING (BDCLOUD 2016) SOCIAL COMPUTING AND NETWORKING (SOCIALCOM 2016) SUSTAINABLE COMPUTING AND COMMUNICATIONS (SUSTAINCOM 2016) (BDCLOUD-SOCIALCOM-SUSTAINCOM 2016), 2016, :477-484
[32]  
Li SL, 2020, AAAI CONF ARTIF INTE, V34, P4650
[33]   A fast and accurate online sequential learning algorithm for feedforward networks [J].
Liang, Nan-Ying ;
Huang, Guang-Bin ;
Saratchandran, P. ;
Sundararajan, N. .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 2006, 17 (06) :1411-1423
[34]   Networks of spiking neurons: The third generation of neural network models [J].
Maass, W .
NEURAL NETWORKS, 1997, 10 (09) :1659-1671
[35]   Learning Precisely Timed Spikes [J].
Memmesheimer, Raoul-Martin ;
Rubin, Ran ;
Oelveczky, Bence P. ;
Sompolinsky, Haim .
NEURON, 2014, 82 (04) :925-938
[36]   Event- and Time-Driven Techniques Using Parallel CPU-GPU Co-processing for Spiking Neural Networks [J].
Naveros, Francisco ;
Garrido, Jesus A. ;
Carrillo, Richard R. ;
Ros, Eduardo ;
Luque, Niceto R. .
FRONTIERS IN NEUROINFORMATICS, 2017, 11
[37]   Surrogate Gradient Learning in Spiking Neural Networks: Bringing the Power of Gradient-based optimization to spiking neural networks [J].
Neftci, Emre O. ;
Mostafa, Hesham ;
Zenke, Friedemann .
IEEE SIGNAL PROCESSING MAGAZINE, 2019, 36 (06) :51-63
[38]   Efficient Neuromorphic Signal Processing with Loihi 2 [J].
Orchard, Garrick ;
Frady, E. Paxon ;
Rubin, Daniel Ben Dayan ;
Sanborn, Sophia ;
Shrestha, Sumit Bam ;
Sommer, Friedrich T. ;
Davies, Mike .
2021 IEEE WORKSHOP ON SIGNAL PROCESSING SYSTEMS (SIPS 2021), 2021, :254-259
[39]   Toward Scalable, Efficient, and Accurate Deep Spiking Neural Networks With Backward Residual Connections, Stochastic Softmax, and Hybridization [J].
Panda, Priyadarshini ;
Aketi, Sai Aparna ;
Roy, Kaushik .
FRONTIERS IN NEUROSCIENCE, 2020, 14
[40]  
Perez-Nieves Nicolas, 2021, Advances in Neural Information Processing Systems, V34