Physics-Informed Echo State Networks for Chaotic Systems Forecasting

被引:30
作者
Doan, Nguyen Anh Khoa [1 ,2 ]
Polifke, Wolfgang [1 ]
Magri, Luca [2 ,3 ]
机构
[1] Tech Univ Munich, Dept Mech Engn, Garching, Germany
[2] Tech Univ Munich, Inst Adv Study, Garching, Germany
[3] Univ Cambridge, Dept Engn, Cambridge, England
来源
COMPUTATIONAL SCIENCE - ICCS 2019, PT IV | 2019年 / 11539卷
关键词
Echo State Networks; Physics-Informed Neural Networks; Chaotic dynamical systems; DEEP NEURAL-NETWORKS;
D O I
10.1007/978-3-030-22747-0_15
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
We propose a physics-informed Echo State Network (ESN) to predict the evolution of chaotic systems. Compared to conventional ESNs, the physics-informed ESNs are trained to solve supervised learning tasks while ensuring that their predictions do not violate physical laws. This is achieved by introducing an additional loss function during the training of the ESNs, which penalizes non-physical predictions without the need of any additional training data. This approach is demonstrated on a chaotic Lorenz system, where the physics-informed ESNs improve the predictability horizon by about two Lyapunov times as compared to conventional ESNs. The proposed framework shows the potential of using machine learning combined with prior physical knowledge to improve the time-accurate prediction of chaotic dynamical systems.
引用
收藏
页码:192 / 198
页数:7
相关论文
共 16 条
[1]   Turbulence Modeling in the Age of Data [J].
Duraisamy, Karthik ;
Iaccarino, Gianluca ;
Xiao, Heng .
ANNUAL REVIEW OF FLUID MECHANICS, VOL 51, 2019, 51 :357-377
[2]   Deep Neural Networks for Acoustic Modeling in Speech Recognition [J].
Hinton, Geoffrey ;
Deng, Li ;
Yu, Dong ;
Dahl, George E. ;
Mohamed, Abdel-rahman ;
Jaitly, Navdeep ;
Senior, Andrew ;
Vanhoucke, Vincent ;
Patrick Nguyen ;
Sainath, Tara N. ;
Kingsbury, Brian .
IEEE SIGNAL PROCESSING MAGAZINE, 2012, 29 (06) :82-97
[3]   Harnessing nonlinearity: Predicting chaotic systems and saving energy in wireless communication [J].
Jaeger, H ;
Haas, H .
SCIENCE, 2004, 304 (5667) :78-80
[4]   Uncertainty encountered when modelling self-excited thermoacoustic oscillations with artificial neural networks [J].
Jaensch, Stefan ;
Polifke, Wolfgang .
INTERNATIONAL JOURNAL OF SPRAY AND COMBUSTION DYNAMICS, 2017, 9 (04) :367-379
[5]   ImageNet Classification with Deep Convolutional Neural Networks [J].
Krizhevsky, Alex ;
Sutskever, Ilya ;
Hinton, Geoffrey E. .
COMMUNICATIONS OF THE ACM, 2017, 60 (06) :84-90
[6]   Reynolds averaged turbulence modelling using deep neural networks with embedded invariance [J].
Ling, Julia ;
Kurzawski, Andrew ;
Templeton, Jeremy .
JOURNAL OF FLUID MECHANICS, 2016, 807 :155-166
[7]  
LORENZ EN, 1963, J ATMOS SCI, V20, P130, DOI 10.1175/1520-0469(1963)020<0130:DNF>2.0.CO
[8]  
2
[9]  
Lukosevicius Mantas, 2012, Neural Networks: Tricks of the Trade. Second Edition: LNCS 7700, P659, DOI 10.1007/978-3-642-35289-8_36
[10]   Reservoir computing approaches to recurrent neural network training [J].
Lukosevicius, Mantas ;
Jaeger, Herbert .
COMPUTER SCIENCE REVIEW, 2009, 3 (03) :127-149