Evolving spiking neural networks for audiovisual information processing

被引:79
作者
Wysoski, Simei Gomes [1 ]
Benuskova, Lubica [1 ,2 ]
Kasabov, Nikola [1 ]
机构
[1] Auckland Univ Technol, Knowledge Engn & Discovery Res Inst, Auckland 1051, New Zealand
[2] Univ Otago, Dept Comp Sci, Dunedin, New Zealand
关键词
Spiking neural network; Audio and visual pattern recognition; Face recognition; Speaker authentication; Online classification; PATTERN-RECOGNITION; OBJECT RECOGNITION; NEURONS; FACE; COMPUTATION; INTEGRATION; MODEL;
D O I
10.1016/j.neunet.2010.04.009
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper presents a new modular and integrative sensory information system inspired by the way the brain performs information processing, in particular, pattern recognition. Spiking neural networks are used to model human-like visual and auditory pathways. This bimodal system is trained to perform the specific task of person authentication. The two unimodal systems are individually tuned and trained to recognize faces and speech signals from spoken utterances, respectively. New learning procedures are designed to operate in an online evolvable and adaptive way. Several ways of modelling sensory integration using spiking neural network architectures are suggested and evaluated in computer experiments. (C) 2010 Elsevier Ltd. All rights reserved.
引用
收藏
页码:819 / 835
页数:17
相关论文
共 50 条
[41]   Spiking neural networks on FPGA: A survey of methodologies and recent advancements [J].
Karamimanesh, Mehrzad ;
Abiri, Ebrahim ;
Shahsavari, Mahyar ;
Hassanli, Kourosh ;
van Schaik, Andre ;
Eshraghian, Jason .
NEURAL NETWORKS, 2025, 186
[42]   Spiking Neural Networks: Background, Recent Development and the NeuCube Architecture [J].
Tan, Clarence ;
Sarlija, Marko ;
Kasabov, Nikola .
NEURAL PROCESSING LETTERS, 2020, 52 (02) :1675-1701
[43]   Nonlinear dynamics and machine learning of recurrent spiking neural networks [J].
Maslennikov, O. V. ;
Pugavko, M. M. ;
Shchapin, D. S. ;
Nekorkin, V. I. .
PHYSICS-USPEKHI, 2022, 65 (10) :1020-1038
[44]   Supervised learning in spiking neural networks: A review of algorithms and evaluations [J].
Wang, Xiangwen ;
Lin, Xianghong ;
Dang, Xiaochao .
NEURAL NETWORKS, 2020, 125 :258-280
[45]   A critical survey of STDP in Spiking Neural Networks for Pattern Recognition [J].
Vigneron, Alex ;
Martinet, Jean .
2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2020,
[46]   Quantifying the Landscape of Decision Making From Spiking Neural Networks [J].
Ye, Leijun ;
Li, Chunhe .
FRONTIERS IN COMPUTATIONAL NEUROSCIENCE, 2021, 15
[47]   Robospike Sensory Processing for a Mobile Robot Using Spiking Neural Networks [J].
Mc Bride, Michael F. ;
McGinnity, T. M. ;
Maguire, Liam P. .
ARTIFICIAL NEURAL NETWORKS - ICANN 2009, PT II, 2009, 5769 :794-+
[48]   Exploiting High Performance Spiking Neural Networks With Efficient Spiking Patterns [J].
Shen, Guobin ;
Zhao, Dongcheng ;
Zeng, Yi .
IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2025, 9 (02) :1480-1489
[49]   Towards Spatio-Temporal Pattern Recognition Using Evolving Spiking Neural Networks [J].
Schliebs, Stefan ;
Nuntalid, Nuttapod ;
Kasabov, Nikola .
NEURAL INFORMATION PROCESSING: THEORY AND ALGORITHMS, PT I, 2010, 6443 :163-170
[50]   A spiking neural network with probability information transmission [J].
Zuo, Lin ;
Chen, Yi ;
Zhang, Lei ;
Chen, Changle .
NEUROCOMPUTING, 2020, 408 :1-12