Model selection for dynamical systems via sparse regression and information criteria

被引:180
作者
Mangan, N. M. [1 ,2 ]
Kutz, J. N. [1 ]
Brunton, S. L. [3 ]
Proctor, J. L. [2 ]
机构
[1] Univ Washington, Dept Appl Math, Seattle, WA 98195 USA
[2] Inst Dis Modeling, Bellevue, WA 98005 USA
[3] Univ Washington, Dept Mech Engn, Seattle, WA 98195 USA
来源
PROCEEDINGS OF THE ROYAL SOCIETY A-MATHEMATICAL PHYSICAL AND ENGINEERING SCIENCES | 2017年 / 473卷 / 2204期
关键词
model selection; information criteria; sparse regression; nonlinear dynamics; data-driven discovery; IDENTIFICATION;
D O I
10.1098/rspa.2017.0009
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
We develop an algorithm for model selection which allows for the consideration of a combinatorially large number of candidate models governing a dynamical system. The innovation circumvents a disadvantage of standard model selection which typically limits the number of candidate models considered due to the intractability of computing information criteria. Using a recently developed sparse identification of nonlinear dynamics algorithm, the sub-selection of candidate models near the Pareto frontier allows feasible computation of Akaike information criteria (AIC) or Bayes information criteria scores for the remaining candidate models. The information criteria hierarchically ranks the most informative models, enabling the automatic and principled selection of the model with the strongest support in relation to the time-series data. Specifically, we show that AIC scores place each candidate model in the strong support, weak support or no support category. The method correctly recovers several canonical dynamical systems, including a susceptible-exposedinfectious-recovered disease model, Burgers' equation and the Lorenz equations, identifying the correct dynamical system as the only candidate model with strong support.
引用
收藏
页数:16
相关论文
共 42 条
[1]   NEW LOOK AT STATISTICAL-MODEL IDENTIFICATION [J].
AKAIKE, H .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 1974, AC19 (06) :716-723
[2]  
Akaike H., 1998, Selected papers of Hirotugu Akaike, P199, DOI [10.1007/978-1-4612-1694-0_15, DOI 10.1007/978-1-4612-1694-0_15]
[3]  
[Anonymous], 1968, Information Theory and Statistics
[4]   Building Predictive Models via Feature Synthesis [J].
Arnaldo, Ignacio ;
O'Reilly, Una-May ;
Veeramachaneni, Kalyan .
GECCO'15: PROCEEDINGS OF THE 2015 GENETIC AND EVOLUTIONARY COMPUTATION CONFERENCE, 2015, :983-990
[5]  
Billings SA, 2013, NONLINEAR SYSTEM IDENTIFICATION: NARMAX METHODS IN THE TIME, FREQUENCY, AND SPATIO-TEMPORAL DOMAINS, P1, DOI 10.1002/9781118535561
[6]  
Bishop C., 2006, Pattern recognition and machine learning, P423
[7]   The role of older children and adults in wild poliovirus transmission [J].
Blake, Isobel M. ;
Martin, Rebecca ;
Goel, Ajay ;
Khetsuriani, Nino ;
Everts, Johannes ;
Wolff, Christopher ;
Wassilak, Steven ;
Aylward, R. Bruce ;
Grassly, Nicholas C. .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2014, 111 (29) :10604-10609
[8]   Automated reverse engineering of nonlinear dynamical systems [J].
Bongard, Josh ;
Lipson, Hod .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2007, 104 (24) :9943-9948
[9]   Chaos as an intermittently forced linear system [J].
Brunton, Steven L. ;
Brunton, Bingni W. ;
Proctor, Joshua L. ;
Kaiser, Eurika ;
Kutz, J. Nathan .
NATURE COMMUNICATIONS, 2017, 8
[10]   Discovering governing equations from data by sparse identification of nonlinear dynamical systems [J].
Brunton, Steven L. ;
Proctor, Joshua L. ;
Kutz, J. Nathan .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2016, 113 (15) :3932-3937