Spiking recurrent neural networks for neuromorphic computing in nonlinear structural mechanics

被引:12
作者
Tandale, Saurabh Balkrishna [1 ]
Stoffel, Marcus [1 ]
机构
[1] Rhein Westfal TH Aachen, Inst Gen Mech, Eilfschornsteinstr 18, D-52056 Aachen, Germany
关键词
Spiking neural networks; Sustainability; Recurrent neural networks; Neuromorphic computing; FINITE-ELEMENTS;
D O I
10.1016/j.cma.2023.116095
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
The present study aims to introduce an AI algorithm suitable for neuromorphic computing to solve Boundary Value Problems in Engineering Mechanics. Following the trend of sustainable Artificial Intelligence (AI), Spiking Neural Networks (SNNs), known as the third generation of neural networks, are proposed for developing surrogate models for mechanical tasks. SNNs are inherently recurrent and communicate through sparse signals consuming only a fraction of the energy needed by artificial neural networks (ANNs) of the second generation such as current deep learning methods. To take advantage of the energy-efficient spike models, an autoencoding strategy is proposed to convert the real-valued data at a certain time step to its binary spike representation which allows the model to be used for regression tasks. Further, we propose a hybrid model consisting of the spiking variant of the Legendre Memory Unit (LMU), spiking recurrent cells, and classical dense transformations to compute the nonlinear (physically and geometrically) response of shock wave-loaded plate elements. The inclusion of spikes enables the proposed model to be deployed on neuromorphic hardware, such as the Loihi chip. Thus, for a series of both training and validation experiments, a detailed comparison of the proposed hybrid model and its second-generation counterpart in terms of energy consumption and accuracy is presented. (c) 2023 Elsevier B.V. All rights reserved.
引用
收藏
页数:18
相关论文
共 50 条
[21]   Watermarking Neuromorphic Brains: Intellectual Property Protection in Spiking Neural Networks [J].
Poursiami, Hamed ;
Alouani, Ihsen ;
Parsa, Maryam .
2024 INTERNATIONAL CONFERENCE ON NEUROMORPHIC SYSTEMS, ICONS, 2024, :287-294
[22]   Evaluation of neuron parameters on the performance of spiking neural networks and neuromorphic hardware [J].
Schuman, Catherine ;
Das, Hritom ;
Rose, Garrett S. ;
Plank, James S. .
2024 IEEE COMPUTER SOCIETY ANNUAL SYMPOSIUM ON VLSI, ISVLSI, 2024, :337-342
[23]   Impact of Noisy Input on Evolved Spiking Neural Networks for Neuromorphic Systems [J].
Patel, Karan P. ;
Schuman, Catherine D. .
PROCEEDINGS OF THE 2023 ANNUAL NEURO-INSPIRED COMPUTATIONAL ELEMENTS CONFERENCE, NICE 2023, 2023, :52-56
[24]   Benchmarking Deep Spiking Neural Networks on Neuromorphic Hardware [J].
Ostrau, Christoph ;
Homburg, Jonas ;
Klarhorst, Christian ;
Thies, Michael ;
Rueckert, Ulrich .
ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, ICANN 2020, PT II, 2020, 12397 :610-621
[25]   Community detection with spiking neural networks for neuromorphic hardware [J].
Hamilton, Kathleen E. ;
Imam, Neena ;
Humble, Travis S. .
PROCEEDINGS OF NEUROMORPHIC COMPUTING SYMPOSIUM (NCS 2017), 2017,
[26]   In-Hardware Learning of Multilayer Spiking Neural Networks on a Neuromorphic Processor [J].
Shrestha, Amar ;
Fang, Haowen ;
Rider, Daniel Patrick ;
Mei, Zaidao ;
Qiu, Qinru .
2021 58TH ACM/IEEE DESIGN AUTOMATION CONFERENCE (DAC), 2021, :367-372
[27]   Autonomous driving controllers with neuromorphic spiking neural networks [J].
Halaly, Raz ;
Tsur, Elishai Ezra .
FRONTIERS IN NEUROROBOTICS, 2023, 17
[28]   Approximate Computing for Spiking Neural Networks [J].
Sen, Sanchari ;
Venkataramani, Swagath ;
Raghunathan, Anand .
PROCEEDINGS OF THE 2017 DESIGN, AUTOMATION & TEST IN EUROPE CONFERENCE & EXHIBITION (DATE), 2017, :193-198
[29]   A Review of Computing with Spiking Neural Networks [J].
Wu, Jiadong ;
Wang, Yinan ;
Li, Zhiwei ;
Lu, Lun ;
Li, Qingjiang .
CMC-COMPUTERS MATERIALS & CONTINUA, 2024, 78 (03) :2909-2939
[30]   A Network Simulator for the Estimation of Bandwidth Load and Latency Created by Heterogeneous Spiking Neural Networks on Neuromorphic Computing Communication Networks [J].
Kleijnen, Robert ;
Robens, Markus ;
Schiek, Michael ;
van Waasen, Stefan .
JOURNAL OF LOW POWER ELECTRONICS AND APPLICATIONS, 2022, 12 (02)