Transfer Learning of Fuzzy Spatio-Temporal Rules in a Brain-Inspired Spiking Neural Network Architecture: A Case Study on Spatio-Temporal Brain Data

被引:4
|
作者
Kasabov, Nikola K. [1 ,2 ,3 ]
Tan, Yongyao [1 ]
Doborjeh, Maryam [1 ]
Tu, Enmei [4 ]
Yang, Jie [4 ]
Goh, Wilson [5 ]
Lee, Jimmy [5 ]
机构
[1] Auckland Univ Technol, Sch Engn Comp & Math Sci, Knowledge Engn & Discovery Res Inst, Auckland 1010, New Zealand
[2] Univ Ulster, Intelligent Syst Res Ctr, Belfast BT15 1ED, North Ireland
[3] Bulgarian Acad Sci, Inst Informat & Commun Technol, Sofia 1000, Bulgaria
[4] Shanghai Jiao Tong Univ, Inst Image Proc & Pattern Recognit, Shanghai 200240, Peoples R China
[5] Nanyang Technol Univ, Nanyang 639798, Singapore
关键词
EEG data; explainable AI; fuzzy spatio-temporal rules; neucube; spatio-temporal learning; spiking neural networks; transfer learning; EEG SIGNALS;
D O I
10.1109/TFUZZ.2023.3292802
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The article demonstrates for the first time that a brain-inspired spiking neural network (SNN) architecture can be used not only to learn spatio-temporal data, but also to extract fuzzy spatio-temporal rules from such data and to update these rules incrementally in a transfer learning mode. We propose a method, where a SNN model learns incrementally new time-space data related to new classes/tasks/categories, always utilizing some previously learned knowledge, and presents the evolved knowledge as fuzzy spatio-temporal rules. Similarly, to how the brain manifests transfer learning, these SNN models do not need to be restricted in number of layers and neurons in each layer as they adopt self-organizing learning principles. The continuously evolved fuzzy rules from spatio-temporal data are interpretable for a better understanding of the processes that generate the data. The proposed method is based on a brain-inspired SNN architecture NeuCube, which is structured according to a brain three-dimensional structural template. It is illustrated on tasks of incremental and transfer learning and knowledge transfer using spatio-temporal data measuring brain activity, when subjects are performing tasks in space and time. The method is a general one and opens the field to create new types of adaptable and explainable spatio-temporal learning systems across domain areas.
引用
收藏
页码:4542 / 4552
页数:11
相关论文
共 50 条
  • [1] NeuCube: A spiking neural network architecture for mapping, learning and understanding of spatio-temporal brain data
    Kasabov, Nikola K.
    NEURAL NETWORKS, 2014, 52 : 62 - 76
  • [2] A brain-inspired computational model for spatio-temporal information processing
    Lin, Xiaohan
    Zou, Xiaolong
    Ji, Zilong
    Huang, Tiejun
    Wu, Si
    Mi, Yuanyuan
    NEURAL NETWORKS, 2021, 143 (143) : 74 - 87
  • [3] Spatio-Temporal Pattern Representation from AI Inspired Brain Model in Spiking Neural Network
    Singh, Narinder Pal
    Sarathy, Partha
    Mantri, Archana
    Singh, Gurjinder
    Ghosh, Debarshi
    Singh, Thakur Gurjeet
    Saluja, Nitin Kumar
    Kaur, Rashpinder
    BIOINTERFACE RESEARCH IN APPLIED CHEMISTRY, 2022, 12 (05): : 6618 - 6631
  • [4] Dynamic 3D Clustering of Spatio-Temporal Brain Data in the NeuCube Spiking Neural Network Architecture on a Case Study of fMRI Data
    Doborjeh, Maryam Gholami
    Kasabov, Nikola
    NEURAL INFORMATION PROCESSING, ICONIP 2015, PT IV, 2015, 9492 : 191 - 198
  • [5] Brain-Inspired Spatio-Temporal Associative Memories for Neuroimaging Data Classification: EEG and fMRI
    Kasabov, Nikola K.
    Bahrami, Helena
    Doborjeh, Maryam
    Wang, Alan
    Zhang, Nanyin
    Boubchir, Larbi
    BIOENGINEERING-BASEL, 2023, 10 (12):
  • [6] Classification and Segmentation of fMRI Spatio-Temporal Brain Data with a NeuCube Evolving Spiking Neural Network Model
    Doborjeh, Maryam Gholami
    Capecci, Elisa
    Kasabov, Nikola
    2014 IEEE SYMPOSIUM ON EVOLVING AND AUTONOMOUS LEARNING SYSTEMS (EALS), 2014, : 73 - 80
  • [7] A Brain-inspired Decision-making Model for Spatio-temporal Pattern Recognition
    Wang, Binyou
    Tan, Bilan
    Zou, Xiaolong
    Lin, Xiaohan
    Huang, Changwei
    Wu, Si
    Mi, Yuanyuan
    2021 6TH IEEE INTERNATIONAL CONFERENCE ON ADVANCED ROBOTICS AND MECHATRONICS (ICARM 2021), 2021, : 554 - 559
  • [8] Spatio-temporal neural data mining architecture in learning robots
    Malone, J
    Elshaw, M
    McGarry, K
    Bowerman, C
    Wermter, S
    PROCEEDINGS OF THE INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), VOLS 1-5, 2005, : 2802 - 2807
  • [9] A brain-inspired spiking neural network model with temporal encoding and learning
    Yu, Qiang
    Tang, Huajin
    Tan, Kay Chen
    Yu, Haoyong
    NEUROCOMPUTING, 2014, 138 : 3 - 13
  • [10] Heterogeneous recurrent spiking neural network for spatio-temporal classification
    Chakraborty, Biswadeep
    Mukhopadhyay, Saibal
    FRONTIERS IN NEUROSCIENCE, 2023, 17