Hybrid acceleration techniques for the physics-informed neural networks: a comparative analysis

被引:0
作者
Fedor Buzaev
Jiexing Gao
Ivan Chuprov
Evgeniy Kazakov
机构
[1] Huawei Technologies Co.,Moscow Research Center, 2012 Labs
[2] Ltd.,undefined
来源
Machine Learning | 2024年 / 113卷
关键词
Physics-informed neural networks; Sinusoidal learning space; Fourier neural operators; Koopman neural operators;
D O I
暂无
中图分类号
学科分类号
摘要
Physics-informed neural networks (PINN) has emerged as a promising approach for solving partial differential equations (PDEs). However, the training process for PINN can be computationally expensive, limiting its practical applications. To address this issue, we investigate several acceleration techniques for PINN that combine Fourier neural operators, separable PINN, and first-order PINN. We also propose novel acceleration techniques based on second-order PINN and Koopman neural operators. We evaluate the efficiency of these techniques on various PDEs, and our results show that the hybrid models can provide much more accurate results than classical PINN under time constraints for the training, making PINN a more viable option for practical applications. The proposed methodology in the manuscript is generic and can be extended on a larger set of problems including inverse problems.
引用
收藏
页码:3675 / 3692
页数:17
相关论文
共 50 条
[31]   Physics-informed Neural Networks with Unknown Measurement Noise [J].
Pilar, Philipp ;
Wahlstroem, Niklas .
6TH ANNUAL LEARNING FOR DYNAMICS & CONTROL CONFERENCE, 2024, 242 :235-247
[32]   Spiking Physics-Informed Neural Networks on Loihi 2 [J].
Theilman, Bradley H. ;
Zhang, Qian ;
Kahana, Adar ;
Cyr, Eric C. ;
Trask, Nathaniel ;
Aimone, James B. ;
Karniadakis, George Em .
2024 NEURO INSPIRED COMPUTATIONAL ELEMENTS CONFERENCE, NICE, 2024,
[33]   Hybrid physics-informed neural networks for lithium-ion battery modeling and prognosis [J].
Nascimento, Renato G. ;
Corbetta, Matteo ;
Kulkarni, Chetan S. ;
Viana, Felipe A. C. .
JOURNAL OF POWER SOURCES, 2021, 513
[34]   Inverse analysis for estimating geotechnical parameters using physics-informed neural networks [J].
Ito, Shinichi ;
Fukunaga, Ryusei ;
Sako, Kazunari .
SOILS AND FOUNDATIONS, 2024, 64 (06)
[35]   Leveraging physics-informed neural networks for wavefield analysis in laser ultrasonic testing [J].
Li, Yang ;
Xu, Bin ;
Zou, Yun ;
Sha, Gaofeng ;
Cai, Guixi .
NONDESTRUCTIVE TESTING AND EVALUATION, 2024,
[36]   Error analysis for physics-informed neural networks (PINNs) approximating Kolmogorov PDEs [J].
De Ryck, Tim ;
Mishra, Siddhartha .
ADVANCES IN COMPUTATIONAL MATHEMATICS, 2022, 48 (06)
[37]   Error analysis for physics-informed neural networks (PINNs) approximating Kolmogorov PDEs [J].
Tim De Ryck ;
Siddhartha Mishra .
Advances in Computational Mathematics, 2022, 48
[38]   Analysis of pedestrian second crossing behavior based on physics-informed neural networks [J].
Guo, Yongqing ;
Zou, Hai ;
Wei, Fulu ;
Li, Qingyin ;
Guo, Dong ;
Pirov, Jahongir .
SCIENTIFIC REPORTS, 2024, 14 (01)
[39]   Physics-informed neural networks for the Reynolds equation with cavitation modeling [J].
Rom, Michael .
TRIBOLOGY INTERNATIONAL, 2023, 179
[40]   Invariant Physics-Informed Neural Networks for Ordinary Differential Equations [J].
Arora, Shivam ;
Bihlo, Alex ;
Valiquette, Francis .
JOURNAL OF MACHINE LEARNING RESEARCH, 2024, 25 :1-24