The spiking neural network based on fMRI for speech recognition

被引:3
|
作者
Song, Yihua [1 ,2 ]
Guo, Lei [1 ,2 ]
Man, Menghua [3 ]
Wu, Youxi [4 ]
机构
[1] Hebei Univ Technol, Sch Hlth Sci & Biomed Engn, Hebei Key Lab Bioelectromagnet & Neuroengn, Tianjin 300131, Peoples R China
[2] Hebei Univ Technol, State Key Lab Reliabil & Intelligence Elect Equipm, Tianjin 300401, Peoples R China
[3] Army Engn Univ PLA, Shijiazhuang Campus, Shijiazhuang 050000, Hebei, Peoples R China
[4] Hebei Univ Technol, Sch Artificial Intelligence, Tianjin 300401, Peoples R China
关键词
functional Magnetic Resonance Imaging; Functional brain network; Spiking neural network; Speech recognition; Neuronal firing activity; Neural information transmission; LIQUID-STATE-MACHINE; MODEL; CLASSIFICATION; ROBUSTNESS; PLASTICITY;
D O I
10.1016/j.patcog.2024.110672
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The structure of the human brain has evolved to achieve extraordinary computing power through continuous refinement by natural selection. At present, the topology of brain -like model lacks biological plausibility. In this paper, a new brain -like model is proposed, called fMRI-SNN, which is a spiking neural network (SNN) constrained by the topology of a functional brain network from human functional Magnetic Resonance Imaging (fMRI) data. To verify its performance, this fMRI-SNN is applied to speech recognition. Our results indicate that the recognition accuracy of fMRI-SNN is superior to that of other SNNs and reported methods, and exhibits stronger performance on more difficult speech recognition tasks. Our discussion on recognition mechanism finds the advantage of fMRI-SNN is that the differences in its neuronal firing patterns are greater than those of other SNNs, since it has better information transmission ability.
引用
收藏
页数:15
相关论文
共 50 条
  • [41] A Neuromorphic Tactile Perception System Based on Spiking Neural Network for Texture Recognition
    Liu, Ziyong
    Wang, Xiaoxin
    Xiang, Guiyao
    Wang, Zhiyong
    Shao, Yitian
    Liu, Honghai
    INTELLIGENT ROBOTICS AND APPLICATIONS, ICIRA 2024, PT IX, 2025, 15209 : 176 - 191
  • [42] Radar-Based Gesture Recognition System using Spiking Neural Network
    Arsalan, Muhammad
    Santra, Avik
    Chmurski, Mateusz
    El-Masry, Moamen
    Mauro, Gianfranco
    Issakov, Vadim
    2021 26TH IEEE INTERNATIONAL CONFERENCE ON EMERGING TECHNOLOGIES AND FACTORY AUTOMATION (ETFA), 2021,
  • [43] Spiking Neural Network Recognition Method Based on Dynamic Visual Motion Features
    Dong, Junfei
    Jiang, Runhao
    Yan, Rui
    Tang, Huajin
    JOURNAL OF ELECTRONICS & INFORMATION TECHNOLOGY, 2023, 45 (08) : 2731 - 2738
  • [44] Defects Recognition of Train Wheelset Tread Based on Improved Spiking Neural Network
    Zhang Changfan
    Huang Congcong
    He Jing
    CHINESE JOURNAL OF ELECTRONICS, 2023, 32 (05) : 941 - 954
  • [45] R-STDP Based Spiking Neural Network for Human Action Recognition
    Berlin, S. Jeba
    John, Mala
    APPLIED ARTIFICIAL INTELLIGENCE, 2020, 34 (09) : 656 - 673
  • [46] Breast Cancer Recognition Using Saliency-Based Spiking Neural Network
    Fu, Qiang
    Dong, Hongbin
    WIRELESS COMMUNICATIONS & MOBILE COMPUTING, 2022, 2022
  • [47] Object and Character Recognition Using Spiking Neural Network
    Bawane, Priyanka
    Gadariye, Snehali
    Chaturvedi, S.
    Khurshid, A. A.
    MATERIALS TODAY-PROCEEDINGS, 2018, 5 (01) : 360 - 366
  • [48] Fractal Spiking Neural Network Scheme for EEG-Based Emotion Recognition
    Li, Wei
    Fang, Cheng
    Zhu, Zhihao
    Chen, Chuyi
    Song, Aiguo
    IEEE JOURNAL OF TRANSLATIONAL ENGINEERING IN HEALTH AND MEDICINE, 2024, 12 : 106 - 118
  • [49] Acceleration of spiking neural network based pattern recognition on NVIDIA graphics processors
    Han, Bing
    Taha, Tarek M.
    APPLIED OPTICS, 2010, 49 (10) : B83 - B91
  • [50] Defects Recognition of Train Wheelset Tread Based on Improved Spiking Neural Network
    ZHANG Changfan
    HUANG Congcong
    HE Jing
    ChineseJournalofElectronics, 2023, 32 (05) : 941 - 954