Toward Efficient Processing and Learning With Spikes: New Approaches for Multispike Learning

被引:11
作者
Yu, Qiang [1 ]
Li, Shenglan [1 ]
Tang, Huajin [2 ,3 ]
Wang, Longbiao [1 ]
Dang, Jianwu [1 ,4 ,5 ]
Tan, Kay Chen [6 ,7 ]
机构
[1] Tianjin Univ, Coll Intelligence & Comp, Tianjin Key Lab Cognit Comp & Applicat, Tianjin 300072, Peoples R China
[2] Zhejiang Univ, Coll Comp Sci & Technol, Hangzhou 310027, Peoples R China
[3] Zhejiang Lab, Hangzhou 311122, Peoples R China
[4] Japan Adv Inst Sci & Technol, Lab Intelligent Informat Proc, Nomi 9231292, Japan
[5] Huiyan Technol Tianjin Co Ltd, Tianjin 300384, Peoples R China
[6] City Univ Hong Kong, Dept Comp Sci, Hong Kong, Peoples R China
[7] City Univ Hong Kong, Shenzhen Res Inst, Shenzhen 518057, Peoples R China
基金
中国国家自然科学基金;
关键词
Neurons; Task analysis; Computational modeling; Biological system modeling; Information processing; Neuromorphics; Feature extraction; multispike learning; neuromorphic computing; robust recognition; spiking neural networks (SNNs); spike-timing-dependent plasticity (STDP); NEURAL-NETWORK; MODEL; CLASSIFICATION; NOISE;
D O I
10.1109/TCYB.2020.2984888
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Spikes are the currency in central nervous systems for information transmission and processing. They are also believed to play an essential role in low-power consumption of the biological systems, whose efficiency attracts increasing attentions to the field of neuromorphic computing. However, efficient processing and learning of discrete spikes still remain a challenging problem. In this article, we make our contributions toward this direction. A simplified spiking neuron model is first introduced with the effects of both synaptic input and firing output on the membrane potential being modeled with an impulse function. An event-driven scheme is then presented to further improve the processing efficiency. Based on the neuron model, we propose two new multispike learning rules which demonstrate better performance over other baselines on various tasks, including association, classification, and feature detection. In addition to efficiency, our learning rules demonstrate high robustness against the strong noise of different types. They can also be generalized to different spike coding schemes for the classification task, and notably, the single neuron is capable of solving multicategory classifications with our learning rules. In the feature detection task, we re-examine the ability of unsupervised spike-timing-dependent plasticity with its limitations being presented, and find a new phenomenon of losing selectivity. In contrast, our proposed learning rules can reliably solve the task over a wide range of conditions without specific constraints being applied. Moreover, our rules cannot only detect features but also discriminate them. The improved performance of our methods would contribute to neuromorphic computing as a preferable choice.
引用
收藏
页码:1364 / 1376
页数:13
相关论文
共 50 条
[31]   Learning the blending spikes using sparse dictionaries [J].
Chen, Yangkang ;
Zu, Shaohuan ;
Chen, Wei ;
Zhang, Mi ;
Guan, Zhe .
GEOPHYSICAL JOURNAL INTERNATIONAL, 2020, 222 (03) :1846-1863
[32]   Realization of natural language processing and machine learning approaches for text-based sentiment analysis [J].
Naithani, Kanchan ;
Raiwani, Yadav Prasad .
EXPERT SYSTEMS, 2023, 40 (05)
[33]   Exploring Deep Learning and Machine Learning Approaches for Brain Hemorrhage Detection [J].
Ahmed, Samia ;
Esha, Jannatul Ferdous ;
Rahman, Md. Sazzadur ;
Kaiser, M. Shamim ;
Hosen, A. S. M. Sanwar ;
Ghimire, Deepak ;
Park, Mi Jin .
IEEE ACCESS, 2024, 12 :45060-45093
[34]   Applications of deep-learning approaches in horticultural research: a review [J].
Yang, Biyun ;
Xu, Yong .
HORTICULTURE RESEARCH, 2021, 8 (01)
[35]   A Review of Android Malware Detection Approaches Based on Machine Learning [J].
Liu, Kaijun ;
Xu, Shengwei ;
Xu, Guoai ;
Zhang, Miao ;
Sun, Dawei ;
Liu, Haifeng .
IEEE ACCESS, 2020, 8 (08) :124579-124607
[36]   New Approaches to Incremental Learning Good Classification Tests [J].
Naidenova, Xenia ;
Parkhomenko, Vladimir ;
Shvetsov, Konstantin .
2016 INTERNATIONAL CONFERENCE ON INFORMATION TECHNOLOGY FOR ORGANIZATIONS DEVELOPMENT (IT4OD), 2016,
[37]   Learning What and Where to Learn: A New Perspective on Self-Supervised Learning [J].
Zhao, Wenyi ;
Yang, Lu ;
Zhang, Weidong ;
Tian, Yongqin ;
Jia, Wenhe ;
Li, Wei ;
Yang, Mu ;
Pan, Xipeng ;
Yang, Huihua .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (08) :6620-6633
[38]   Efficient Multiview Representation Learning With Correntropy and Anchor Graph [J].
Zhang, Nan ;
Zhang, Xiaoqin ;
Sun, Shiliang .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2024, 36 (09) :4632-4645
[39]   Online Feature Selection for Efficient Learning in Networked Systems [J].
Wang, Xiaoxuan ;
Stadler, Rolf .
IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, 2022, 19 (03) :2885-2898
[40]   An Efficient Deep Learning Model for Olive Diseases Detection [J].
Alruwaili, Madallah ;
Abd El-Ghany, Sameh ;
Alanazi, Saad ;
Shehab, Abdulaziz .
INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2019, 10 (08) :486-492