Brain-Inspired Spiking Neural Network for Online Unsupervised Time Series Prediction

被引:2
作者
Chakraborty, Biswadeep [1 ]
Mukhopadhyay, Saibal [1 ]
机构
[1] Georgia Inst Technol, Atlanta, GA 30332 USA
来源
2023 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN | 2023年
关键词
spiking neural network; recurrent; STDP; Wasserstein distance; persistent homologies; online time series prediction; OPTIMIZATION;
D O I
10.1109/IJCNN54540.2023.10191645
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Energy and data-efficient online time series prediction for predicting evolving dynamical systems are critical in several fields, especially edge AI applications that need to update continuously based on streaming data. However, current Deep Neural Network (DNN)-based supervised online learning models require a large amount of training data and cannot quickly adapt when the underlying system changes. Moreover, these models require continuous retraining with incoming data making them highly inefficient. We present a novel Continuous Learning-based Unsupervised Recurrent Spiking Neural Network Model (CLURSNN), trained with spike timing dependent plasticity (STDP) to solve these issues. CLURSNN makes online predictions by reconstructing the underlying dynamical system using Random Delay Embedding by measuring the membrane potential of neurons in the recurrent layer of the recurrent spiking neural network (RSNN) with the highest betweenness centrality. We also use topological data analysis to propose a novel methodology using the Wasserstein Distance between the persistent homologies of the predicted and observed time series as a loss function. We show that the proposed online time series prediction methodology outperforms state-of-the-art DNN models when predicting an evolving Lorenz63 dynamical system.
引用
收藏
页数:8
相关论文
共 31 条
[1]   Task-Free Continual Learning [J].
Aljundi, Rahaf ;
Kelchtermans, Klaas ;
Tuytelaars, Tinne .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :11246-11255
[2]  
Anava Oren, 2013, C LEARNING THEORY, V30, P172
[3]  
Bhatnagar Aadyot, 2021, ARXIV210909265
[4]   The Persistence Landscape and Some of Its Properties [J].
Bubenik, Peter .
TOPOLOGICAL DATA ANALYSIS, ABEL SYMPOSIUM 2018, 2020, 15 :97-117
[5]   Characterization of Generalizability of Spike Timing Dependent Plasticity Trained Spiking Neural Networks [J].
Chakraborty, Biswadeep ;
Mukhopadhyay, Saibal .
FRONTIERS IN NEUROSCIENCE, 2021, 15
[6]   A Fully Spiking Hybrid Neural Network for Energy-Efficient Object Detection [J].
Chakraborty, Biswadeep ;
She, Xueyuan ;
Mukhopadhyay, Saibal .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 :9014-9029
[7]  
Chakraborty Biswadeep, 2023, 11 INT C LEARN UNPUB
[8]  
Chakraborty Biswadeep, 2022, ARXIV221104297
[9]   A Survey of Recent Advances in Edge-Computing-Powered Artificial Intelligence of Things [J].
Chang, Zhuoqing ;
Liu, Shubo ;
Xiong, Xingxing ;
Cai, Zhaohui ;
Tu, Guoqing .
IEEE INTERNET OF THINGS JOURNAL, 2021, 8 (18) :13849-13875
[10]   A survey on application of machine learning for Internet of Things [J].
Cui, Laizhong ;
Yang, Shu ;
Chen, Fei ;
Ming, Zhong ;
Lu, Nan ;
Qin, Jing .
INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2018, 9 (08) :1399-1417