Spiking recurrent neural networks for neuromorphic computing in nonlinear structural mechanics

被引:9
作者
Tandale, Saurabh Balkrishna [1 ]
Stoffel, Marcus [1 ]
机构
[1] Rhein Westfal TH Aachen, Inst Gen Mech, Eilfschornsteinstr 18, D-52056 Aachen, Germany
关键词
Spiking neural networks; Sustainability; Recurrent neural networks; Neuromorphic computing; FINITE-ELEMENTS;
D O I
10.1016/j.cma.2023.116095
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
The present study aims to introduce an AI algorithm suitable for neuromorphic computing to solve Boundary Value Problems in Engineering Mechanics. Following the trend of sustainable Artificial Intelligence (AI), Spiking Neural Networks (SNNs), known as the third generation of neural networks, are proposed for developing surrogate models for mechanical tasks. SNNs are inherently recurrent and communicate through sparse signals consuming only a fraction of the energy needed by artificial neural networks (ANNs) of the second generation such as current deep learning methods. To take advantage of the energy-efficient spike models, an autoencoding strategy is proposed to convert the real-valued data at a certain time step to its binary spike representation which allows the model to be used for regression tasks. Further, we propose a hybrid model consisting of the spiking variant of the Legendre Memory Unit (LMU), spiking recurrent cells, and classical dense transformations to compute the nonlinear (physically and geometrically) response of shock wave-loaded plate elements. The inclusion of spikes enables the proposed model to be deployed on neuromorphic hardware, such as the Loihi chip. Thus, for a series of both training and validation experiments, a detailed comparison of the proposed hybrid model and its second-generation counterpart in terms of energy consumption and accuracy is presented. (c) 2023 Elsevier B.V. All rights reserved.
引用
收藏
页数:18
相关论文
共 50 条
  • [21] Impact of Noisy Input on Evolved Spiking Neural Networks for Neuromorphic Systems
    Patel, Karan P.
    Schuman, Catherine D.
    PROCEEDINGS OF THE 2023 ANNUAL NEURO-INSPIRED COMPUTATIONAL ELEMENTS CONFERENCE, NICE 2023, 2023, : 52 - 56
  • [22] Community detection with spiking neural networks for neuromorphic hardware
    Hamilton, Kathleen E.
    Imam, Neena
    Humble, Travis S.
    PROCEEDINGS OF NEUROMORPHIC COMPUTING SYMPOSIUM (NCS 2017), 2017,
  • [23] In-Hardware Learning of Multilayer Spiking Neural Networks on a Neuromorphic Processor
    Shrestha, Amar
    Fang, Haowen
    Rider, Daniel Patrick
    Mei, Zaidao
    Qiu, Qinru
    2021 58TH ACM/IEEE DESIGN AUTOMATION CONFERENCE (DAC), 2021, : 367 - 372
  • [24] Autonomous driving controllers with neuromorphic spiking neural networks
    Halaly, Raz
    Tsur, Elishai Ezra
    FRONTIERS IN NEUROROBOTICS, 2023, 17
  • [25] Approximate Computing for Spiking Neural Networks
    Sen, Sanchari
    Venkataramani, Swagath
    Raghunathan, Anand
    PROCEEDINGS OF THE 2017 DESIGN, AUTOMATION & TEST IN EUROPE CONFERENCE & EXHIBITION (DATE), 2017, : 193 - 198
  • [26] A Review of Computing with Spiking Neural Networks
    Wu, Jiadong
    Wang, Yinan
    Li, Zhiwei
    Lu, Lun
    Li, Qingjiang
    CMC-COMPUTERS MATERIALS & CONTINUA, 2024, 78 (03): : 2909 - 2939
  • [27] A Network Simulator for the Estimation of Bandwidth Load and Latency Created by Heterogeneous Spiking Neural Networks on Neuromorphic Computing Communication Networks
    Kleijnen, Robert
    Robens, Markus
    Schiek, Michael
    van Waasen, Stefan
    JOURNAL OF LOW POWER ELECTRONICS AND APPLICATIONS, 2022, 12 (02)
  • [28] A Network Simulator for the Estimation of Bandwidth Load and Latency created by Heterogeneous Spiking Neural Networks on Neuromorphic Computing Communication Networks
    Kleijnen, R.
    Robens, M.
    Schiek, M.
    van Waasen, S.
    2021 IEEE 14TH INTERNATIONAL SYMPOSIUM ON EMBEDDED MULTICORE/MANY-CORE SYSTEMS-ON-CHIP (MCSOC 2021), 2021, : 320 - 327
  • [29] Neuromorphic implementations of neurobiological learning algorithms for spiking neural networks
    Walter, Florian
    Roehrbein, Florian
    Knoll, Alois
    NEURAL NETWORKS, 2015, 72 : 152 - 167
  • [30] Optimizing the Energy Consumption of Spiking Neural Networks for Neuromorphic Applications
    Sorbaro, Martino
    Liu, Qian
    Bortone, Massimo
    Sheik, Sadique
    FRONTIERS IN NEUROSCIENCE, 2020, 14