The spiking neural network based on fMRI for speech recognition

被引:3
|
作者
Song, Yihua [1 ,2 ]
Guo, Lei [1 ,2 ]
Man, Menghua [3 ]
Wu, Youxi [4 ]
机构
[1] Hebei Univ Technol, Sch Hlth Sci & Biomed Engn, Hebei Key Lab Bioelectromagnet & Neuroengn, Tianjin 300131, Peoples R China
[2] Hebei Univ Technol, State Key Lab Reliabil & Intelligence Elect Equipm, Tianjin 300401, Peoples R China
[3] Army Engn Univ PLA, Shijiazhuang Campus, Shijiazhuang 050000, Hebei, Peoples R China
[4] Hebei Univ Technol, Sch Artificial Intelligence, Tianjin 300401, Peoples R China
关键词
functional Magnetic Resonance Imaging; Functional brain network; Spiking neural network; Speech recognition; Neuronal firing activity; Neural information transmission; LIQUID-STATE-MACHINE; MODEL; CLASSIFICATION; ROBUSTNESS; PLASTICITY;
D O I
10.1016/j.patcog.2024.110672
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The structure of the human brain has evolved to achieve extraordinary computing power through continuous refinement by natural selection. At present, the topology of brain -like model lacks biological plausibility. In this paper, a new brain -like model is proposed, called fMRI-SNN, which is a spiking neural network (SNN) constrained by the topology of a functional brain network from human functional Magnetic Resonance Imaging (fMRI) data. To verify its performance, this fMRI-SNN is applied to speech recognition. Our results indicate that the recognition accuracy of fMRI-SNN is superior to that of other SNNs and reported methods, and exhibits stronger performance on more difficult speech recognition tasks. Our discussion on recognition mechanism finds the advantage of fMRI-SNN is that the differences in its neuronal firing patterns are greater than those of other SNNs, since it has better information transmission ability.
引用
收藏
页数:15
相关论文
共 50 条
  • [31] Automatic Image and Speech Recognition Based on Neural Network
    Krol, Dariusz
    Szlachetko, Boguslaw
    JOURNAL OF INFORMATION TECHNOLOGY RESEARCH, 2010, 3 (02) : 1 - 17
  • [32] GaitSpike: Event-based Gait Recognition With Spiking Neural Network
    Tao, Ying
    Chang, Chip-Hong
    Saighi, Sylvain
    Gao, Shengyu
    2024 IEEE 6TH INTERNATIONAL CONFERENCE ON AI CIRCUITS AND SYSTEMS, AICAS 2024, 2024, : 357 - 361
  • [33] Speech Enhancement Method Based On LSTM Neural Network for Speech Recognition
    Liu, Ming
    Wang, Yujun
    Wang, Jin
    Wang, Jing
    Xie, Xiang
    PROCEEDINGS OF 2018 14TH IEEE INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING (ICSP), 2018, : 245 - 249
  • [34] Deep Neural Network Based Speech Separation for Robust Speech Recognition
    Tu Yanhui
    Jun, Du
    Xu Yong
    Dai Lirong
    Chin-Hui, Lee
    2014 12TH INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING (ICSP), 2014, : 532 - 536
  • [35] End-to-End Spiking Neural Network for Speech Recognition Using Resonating Input Neurons
    Auge, Daniel
    Hille, Julian
    Kreutz, Felix
    Mueller, Etienne
    Knoll, Alois
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, ICANN 2021, PT V, 2021, 12895 : 245 - 256
  • [36] Using a Harmony Search Algorithm/Spiking Neural Network Hybrid for Speech Recognition in a Noisy Environment
    Reid, David
    Barrett-Baxendale, Mark
    IMCIC'11: THE 2ND INTERNATIONAL MULTI-CONFERENCE ON COMPLEXITY, INFORMATICS AND CYBERNETICS, VOL I, 2011, : 145 - 150
  • [37] Small-world spiking neural network with anti-interference ability based on speech recognition under interference
    Guo, Lei
    Zhao, Qi
    Wu, Youxi
    Xu, Guizhi
    APPLIED SOFT COMPUTING, 2022, 130
  • [38] Neuromorphic Speech Recognition With Photonic Convolutional Spiking Neural Networks
    Xiang, Shuiying
    Zhang, Tianrui
    Han, Yanan
    Guo, Xingxing
    Zhang, Yahui
    Shi, Yuechun
    Hao, Yue
    IEEE JOURNAL OF SELECTED TOPICS IN QUANTUM ELECTRONICS, 2023, 29 (06)
  • [39] Video-based Disguise Face Recognition Based on Deep Spiking Neural Network
    Liu, Daqi
    Yue, Shigang
    2018 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2018, : 837 - 844
  • [40] A Study on Speech Recognition by a Neural Network Based on English Speech Feature Parameters
    Mao, Congmin
    Liu, Sujing
    JOURNAL OF ADVANCED COMPUTATIONAL INTELLIGENCE AND INTELLIGENT INFORMATICS, 2024, 28 (03) : 679 - 684