Spiking recurrent neural networks for neuromorphic computing in nonlinear structural mechanics

被引:12
作者
Tandale, Saurabh Balkrishna [1 ]
Stoffel, Marcus [1 ]
机构
[1] Rhein Westfal TH Aachen, Inst Gen Mech, Eilfschornsteinstr 18, D-52056 Aachen, Germany
关键词
Spiking neural networks; Sustainability; Recurrent neural networks; Neuromorphic computing; FINITE-ELEMENTS;
D O I
10.1016/j.cma.2023.116095
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
The present study aims to introduce an AI algorithm suitable for neuromorphic computing to solve Boundary Value Problems in Engineering Mechanics. Following the trend of sustainable Artificial Intelligence (AI), Spiking Neural Networks (SNNs), known as the third generation of neural networks, are proposed for developing surrogate models for mechanical tasks. SNNs are inherently recurrent and communicate through sparse signals consuming only a fraction of the energy needed by artificial neural networks (ANNs) of the second generation such as current deep learning methods. To take advantage of the energy-efficient spike models, an autoencoding strategy is proposed to convert the real-valued data at a certain time step to its binary spike representation which allows the model to be used for regression tasks. Further, we propose a hybrid model consisting of the spiking variant of the Legendre Memory Unit (LMU), spiking recurrent cells, and classical dense transformations to compute the nonlinear (physically and geometrically) response of shock wave-loaded plate elements. The inclusion of spikes enables the proposed model to be deployed on neuromorphic hardware, such as the Loihi chip. Thus, for a series of both training and validation experiments, a detailed comparison of the proposed hybrid model and its second-generation counterpart in terms of energy consumption and accuracy is presented. (c) 2023 Elsevier B.V. All rights reserved.
引用
收藏
页数:18
相关论文
共 50 条
[41]   Run-time Mapping of Spiking Neural Networks to Neuromorphic Hardware [J].
Adarsha Balaji ;
Thibaut Marty ;
Anup Das ;
Francky Catthoor .
Journal of Signal Processing Systems, 2020, 92 :1293-1302
[42]   Run-time Mapping of Spiking Neural Networks to Neuromorphic Hardware [J].
Balaji, Adarsha ;
Marty, Thibaut ;
Das, Anup ;
Catthoor, Francky .
JOURNAL OF SIGNAL PROCESSING SYSTEMS FOR SIGNAL IMAGE AND VIDEO TECHNOLOGY, 2020, 92 (11) :1293-1302
[43]   Neuromorphic Spiking Neural Networks and Their Memristor-CMOS Hardware Implementations [J].
Camunas-Mesa, Luis A. ;
Linares-Barranco, Bernabe ;
Serrano-Gotarredona, Teresa .
MATERIALS, 2019, 12 (17)
[44]   A comprehensive multimodal benchmark of neuromorphic training frameworks for spiking neural networks [J].
Cheng, Ying-Chao ;
Hu, Wang-Xin ;
He, Yu-Lin ;
Huang, Joshua Zhexue .
ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2025, 159
[45]   Endurance-Aware Mapping of Spiking Neural Networks to Neuromorphic Hardware [J].
Titirsha, Twisha ;
Song, Shihao ;
Das, Anup ;
Krichmar, Jeffrey ;
Dutt, Nikil ;
Kandasamy, Nagarajan ;
Catthoor, Francky .
IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2022, 33 (02) :288-301
[46]   NeuroMoCo: a neuromorphic momentum contrast learning method for spiking neural networks [J].
Ma, Yuqi ;
Wang, Huamin ;
Shen, Hangchi ;
Chen, Xuemei ;
Duan, Shukai ;
Wen, Shiping .
APPLIED INTELLIGENCE, 2025, 55 (02)
[47]   Thermal-Aware Compilation of Spiking Neural Networks to Neuromorphic Hardware [J].
Titirsha, Twisha ;
Das, Anup .
LANGUAGES AND COMPILERS FOR PARALLEL COMPUTING, LCPC 2020, 2022, 13149 :134-150
[48]   Stochastic Computing Can Improve Upon Digital Spiking Neural Networks [J].
Smithson, Sean C. ;
Boga, Kaushik ;
Ardakani, Arash ;
Meyer, Brett H. ;
Gross, Warren J. .
2016 IEEE INTERNATIONAL WORKSHOP ON SIGNAL PROCESSING SYSTEMS (SIPS), 2016, :309-314
[49]   Efficient Hardware Acceleration of Spiking Neural Networks using FPGA: Towards Real-Time Edge Neuromorphic Computing [J].
El Maachi, Soukaina ;
Chehri, Abdellah ;
Saadane, Rachid .
2024 IEEE 99TH VEHICULAR TECHNOLOGY CONFERENCE, VTC2024-SPRING, 2024,
[50]   Neuro-symbolic computing with spiking neural networks [J].
Dold, Dominik ;
Soler Garrido, Josep ;
Chian, Victor Caceres ;
Hildebrandt, Marcel ;
Runkler, Thomas .
PROCEEDINGS OF INTERNATIONAL CONFERENCE ON NEUROMORPHIC SYSTEMS 2022, ICONS 2022, 2022,