Robust data-driven discovery of governing physical laws with error bars

被引:137
作者
Zhang, Sheng [1 ]
Lin, Guang [1 ,2 ]
机构
[1] Purdue Univ, Dept Math, W Lafayette, IN 47907 USA
[2] Purdue Univ, Sch Mech Engn, W Lafayette, IN 47907 USA
来源
PROCEEDINGS OF THE ROYAL SOCIETY A-MATHEMATICAL PHYSICAL AND ENGINEERING SCIENCES | 2018年 / 474卷 / 2217期
基金
美国国家科学基金会;
关键词
machine learning; predictive modelling; data-driven scientific computing; Bayesian inference; relevance vector machine; sparse regression; partial differential equations; parameter estimation; SPARSE IDENTIFICATION; INFERENCE;
D O I
10.1098/rspa.2018.0305
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Discovering governing physical laws from noisy data is a grand challenge in many science and engineering research areas. We present a new approach to data-driven discovery of ordinary differential equations (ODEs) and partial differential equations (PDEs), in explicit or implicit form. We demonstrate our approach on a wide range of problems, including shallow water equations and Navier-Stokes equations. The key idea is to select candidate terms for the underlying equations using dimensional analysis, and to approximate the weights of the terms with error bars using our threshold sparse Bayesian regression. This new algorithm employs Bayesian inference to tune the hyperparameters automatically. Our approach is effective, robust and able to quantify uncertainties by providing an error bar for each discovered candidate equation. The effectiveness of our algorithm is demonstrated through a collection of classical ODEs and PDEs. Numerical experiments demonstrate the robustness of our algorithm with respect to noisy data and its ability to discover various candidate equations with error bars that represent the quantified uncertainties. Detailed comparisons with the sequential threshold least-squares algorithm and the lasso algorithm are studied from noisy time-series measurements and indicate that the proposed method provides more robust and accurate results. In addition, the data-driven prediction of dynamics with error bars using discovered governing physical laws is more accurate and robust than classical polynomial regressions.
引用
收藏
页数:22
相关论文
共 37 条
[1]   MORE IS DIFFERENT - BROKEN SYMMETRY AND NATURE OF HIERARCHICAL STRUCTURE OF SCIENCE [J].
ANDERSON, PW .
SCIENCE, 1972, 177 (4047) :393-&
[2]  
[Anonymous], EXTRACTING STRUCTURE
[3]  
[Anonymous], SPARSE LEARNING STOC
[4]  
[Anonymous], EXTRACTING SPARSE HI
[5]  
[Anonymous], 2018, CONVERGENCE SINDY AL
[6]  
Avenue J. J. T., 2003, PROC 9 INT WORKSHOP, P3
[7]   IEEE-SPS and connexions - An open access education collaboration [J].
Baraniuk, Richard G. ;
Burrus, C. Sidney ;
Thierstein, E. Joel .
IEEE SIGNAL PROCESSING MAGAZINE, 2007, 24 (06) :6-+
[8]  
Berger JO., 2013, Statistical decision theory and Bayesian analysis
[9]   Automated reverse engineering of nonlinear dynamical systems [J].
Bongard, Josh ;
Lipson, Hod .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2007, 104 (24) :9943-9948
[10]   Discovering governing equations from data by sparse identification of nonlinear dynamical systems [J].
Brunton, Steven L. ;
Proctor, Joshua L. ;
Kutz, J. Nathan .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2016, 113 (15) :3932-3937