Spiking recurrent neural networks for neuromorphic computing in nonlinear structural mechanics

被引:9
|
作者
Tandale, Saurabh Balkrishna [1 ]
Stoffel, Marcus [1 ]
机构
[1] Rhein Westfal TH Aachen, Inst Gen Mech, Eilfschornsteinstr 18, D-52056 Aachen, Germany
关键词
Spiking neural networks; Sustainability; Recurrent neural networks; Neuromorphic computing; FINITE-ELEMENTS;
D O I
10.1016/j.cma.2023.116095
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
The present study aims to introduce an AI algorithm suitable for neuromorphic computing to solve Boundary Value Problems in Engineering Mechanics. Following the trend of sustainable Artificial Intelligence (AI), Spiking Neural Networks (SNNs), known as the third generation of neural networks, are proposed for developing surrogate models for mechanical tasks. SNNs are inherently recurrent and communicate through sparse signals consuming only a fraction of the energy needed by artificial neural networks (ANNs) of the second generation such as current deep learning methods. To take advantage of the energy-efficient spike models, an autoencoding strategy is proposed to convert the real-valued data at a certain time step to its binary spike representation which allows the model to be used for regression tasks. Further, we propose a hybrid model consisting of the spiking variant of the Legendre Memory Unit (LMU), spiking recurrent cells, and classical dense transformations to compute the nonlinear (physically and geometrically) response of shock wave-loaded plate elements. The inclusion of spikes enables the proposed model to be deployed on neuromorphic hardware, such as the Loihi chip. Thus, for a series of both training and validation experiments, a detailed comparison of the proposed hybrid model and its second-generation counterpart in terms of energy consumption and accuracy is presented. (c) 2023 Elsevier B.V. All rights reserved.
引用
收藏
页数:18
相关论文
共 50 条
  • [1] A Survey of Neuromorphic Computing Based on Spiking Neural Networks
    Zhang Ming
    Gu Zonghua
    Pan Gang
    CHINESE JOURNAL OF ELECTRONICS, 2018, 27 (04) : 667 - 674
  • [2] A Survey of Neuromorphic Computing Based on Spiking Neural Networks
    ZHANG Ming
    GU Zonghua
    PAN Gang
    ChineseJournalofElectronics, 2018, 27 (04) : 667 - 674
  • [3] A Bibliometric Review of Neuromorphic Computing and Spiking Neural Networks
    Pritchard, Nicholas J.
    Wicenec, Andreas
    Bennamoun, Mohammed
    Dodson, Richard
    arXiv, 2023,
  • [4] Spiking Neural Networks for LPI Radar Waveform Recognition with Neuromorphic Computing
    Henderson, Alex
    Harbour, Steven
    Yakopcic, Chris
    Taha, Tarek
    Brown, David
    Tieman, Justin
    Hall, Garrett
    2023 IEEE RADAR CONFERENCE, RADARCONF23, 2023,
  • [5] Exploring Neuromorphic Computing Based on Spiking Neural Networks: Algorithms to Hardware
    Rathi, Nitin
    Chakraborty, Indranil
    Kosta, Adarsh
    Sengupta, Abhronil
    Ankit, Aayush
    Panda, Priyadarshini
    Roy, Kaushik
    ACM COMPUTING SURVEYS, 2023, 55 (12)
  • [6] TRAINING DEEP SPIKING NEURAL NETWORKS FOR ENERGY-EFFICIENT NEUROMORPHIC COMPUTING
    Srinivasan, Gopalakrishnan
    Lee, Chankyu
    Sengupta, Abhronil
    Panda, Priyadarshini
    Sarwar, Syed Shakib
    Roy, Kaushik
    2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2020, : 8549 - 8553
  • [7] Conversion of Artificial Recurrent Neural Networks to Spiking Neural Networks for Low-power Neuromorphic Hardware
    Diehl, Peter U.
    Zarrella, Guido
    Cassidy, Andrew
    Pedroni, Bruno U.
    Neftci, Emre
    2016 IEEE INTERNATIONAL CONFERENCE ON REBOOTING COMPUTING (ICRC), 2016,
  • [8] Semiconductor lasers for photonic neuromorphic computing and photonic spiking neural networks: A perspective
    Xiang, Shuiying
    Han, Yanan
    Gao, Shuang
    Song, Ziwei
    Zhang, Yahui
    Zheng, Dianzhuang
    Yu, Chengyang
    Guo, Xingxing
    Zeng, Xintao
    Huang, Zhiquan
    Hao, Yue
    APL PHOTONICS, 2024, 9 (07)
  • [9] Biologically-inspired training of spiking recurrent neural networks with neuromorphic hardware
    Bohnstingl, Thomas
    Surina, Anja
    Fabre, Maxime
    Demirag, Yigit
    Frenkel, Charlotte
    Payvand, Melika
    Indiveri, Giacomo
    Pantazi, Angeliki
    2022 IEEE INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE CIRCUITS AND SYSTEMS (AICAS 2022): INTELLIGENT TECHNOLOGY IN THE POST-PANDEMIC ERA, 2022, : 218 - 221
  • [10] Assessment of Recurrent Spiking Neural Networks on Neuromorphic Accelerators for Naturalistic Texture Classification
    Ali, Haydar Al Haj
    Dabbous, Ali
    Ibrahim, Ali
    Valle, Maurizio
    2023 18TH CONFERENCE ON PH.D RESEARCH IN MICROELECTRONICS AND ELECTRONICS, PRIME, 2023, : 285 - 288