On-Chip Incremental Learning based on Unsupervised STDP Implementation

被引:0
作者
Chen, Guang [1 ]
Cao, Jian [1 ,2 ]
Feng, Shuo [1 ]
Wang, Zilin [3 ]
Zhong, Yi [3 ]
Li, Qibin [1 ]
Zhao, Xiongbo [1 ,4 ]
Zhang, Xing [2 ,3 ]
Wang, Yuan [2 ,3 ]
机构
[1] Peking Univ, Sch Software & Microelect, Beijing, Peoples R China
[2] Peking Univ, MPW Ctr, Key Lab Microelect Devices & Circuits MoE, Beijing 100871, Peoples R China
[3] Peking Univ, Sch Integrated Circuits, Beijing 100871, Peoples R China
[4] Beijing Aerosp Automat Control Inst, Beijing 100854, Peoples R China
来源
2024 IEEE 6TH INTERNATIONAL CONFERENCE ON AI CIRCUITS AND SYSTEMS, AICAS 2024 | 2024年
关键词
On-chip incremental learning; spike-timing-dependent plasticity (STDP); competitive spike neural network (SNN); weight decay; data replay;
D O I
10.1109/AICAS59952.2024.10595970
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Spiking neural network (SNN), a bio-inspired neuron network, utilizes a learning rule named spike-timing-dependent plasticity (STDP) to achieve high-performance unsupervised learning. However, it may suffer from catastrophic forgetting when the distribution of new data significantly differs from that of old data. To address this issue, an incremental learning implementation for ship classification is presented in this paper. We develop an incremental learning algorithm based on STDP and corresponding platform. A competitive SNN is built into our algorithm, and add-STDP is utilized to update the weights of network for efficient learning. To enhance learning performance, we incorporate weight decay. And to avoid catastrophic forgetting, we incorporate data replay. The corresponding learning platform consists of the FPGA Zynq 7100 and the STDP neuromorphic prototype chip, and our algorithm is executed on the chip. We evaluate the ship classification task on our platform, which demonstrates the superior potential of our on-chip implementation for incremental learning.
引用
收藏
页码:332 / 336
页数:5
相关论文
共 24 条
[1]   LONG-LASTING POTENTIATION OF SYNAPTIC TRANSMISSION IN DENTATE AREA OF ANESTHETIZED RABBIT FOLLOWING STIMULATION OF PERFORANT PATH [J].
BLISS, TVP ;
LOMO, T .
JOURNAL OF PHYSIOLOGY-LONDON, 1973, 232 (02) :331-356
[2]   A Fast Threshold Neural Network for Ship Detection in Large-Scene SAR Images [J].
Cui, Jingyu ;
Jia, Hecheng ;
Wang, Haipeng ;
Xu, Feng .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2022, 15 :6016-6032
[3]   Efficient codes and balanced networks [J].
Deneve, Sophie ;
Machens, Christian K. .
NATURE NEUROSCIENCE, 2016, 19 (03) :375-382
[4]   Rethinking the performance comparison between SNNS and ANNS [J].
Deng, Lei ;
Wu, Yujie ;
Hu, Xing ;
Liang, Ling ;
Ding, Yufei ;
Li, Guoqi ;
Zhao, Guangshe ;
Li, Peng ;
Xie, Yuan .
NEURAL NETWORKS, 2020, 121 :294-307
[5]  
Gomar S, 2018, IEEE IJCNN
[6]  
Goutte C, 2005, LECT NOTES COMPUT SC, V3408, P345
[7]   FUSAR-Ship: building a high-resolution SAR-AIS matchup dataset of Gaofen-3 for ship detection and recognition [J].
Hou, Xiyue ;
Ao, Wei ;
Song, Qian ;
Lai, Jian ;
Wang, Haipeng ;
Xu, Feng .
SCIENCE CHINA-INFORMATION SCIENCES, 2020, 63 (04)
[8]  
ITO M, 1989, ANNU REV NEUROSCI, V12, P85, DOI 10.1146/annurev.ne.12.030189.000505
[9]  
Goodfellow IJ, 2015, Arxiv, DOI [arXiv:1312.6211, DOI 10.48550/ARXIV.1312.6211]
[10]  
Kemker R, 2018, Arxiv, DOI arXiv:1711.10563