Asymptotic Theory of l1-Regularized PDE Identification from a Single Noisy Trajectory

被引:4
作者
He, Yuchen [1 ]
Suh, Namjoon [2 ]
Huo, Xiaoming [2 ]
Kang, Sung Ha [3 ]
Mei, Yajun [2 ]
机构
[1] Shanghai Jiao Tong Univ, Inst Nat Sci, Shanghai, Peoples R China
[2] Georgia Inst Technol, Sch Ind & Syst Engn, Atlanta, GA 30332 USA
[3] Georgia Inst Technol, Sch Math, Atlanta, GA 30332 USA
关键词
parital differential equation (PDE); lasso; pseudo least square; signed-support recovery; primal-dual witness construction; local-polynomial regression; STRONG UNIFORM CONSISTENCY; UNCERTAINTY PRINCIPLES; VARIABLE SELECTION; REGRESSION; RECOVERY; REPRESENTATIONS; EQUATIONS; MODELS; RATES; WEAK;
D O I
10.1137/21M1398884
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
We provide a formal theoretical analysis on the PDE identification via the '1-regularized pseudo least square method from the statistical point of view. In this article, we assume that the differential equation governing the dynamic system can be represented as a linear combination of various linear and nonlinear differential terms. Under noisy observations, we employ local-polynomial fitting for estimating state variables and apply the '1 penalty for model selection. Our theory proves that the classical mutual incoherence condition on the feature matrix F and the beta* min-condition for the ground-truth signal beta* are sufficient for the signed-support recovery of the '1-PsLS method. We run numerical experiments on two popular PDE models, the viscous Burgers and the Korteweg-de Vries (KdV) equations, and the results from the experiments corroborate our theoretical predictions.
引用
收藏
页码:1012 / 1036
页数:25
相关论文
共 45 条
[1]   l1-regularized linear regression: persistence and oracle inequalities [J].
Bartlett, Peter L. ;
Mendelson, Shahar ;
Neeman, Joseph .
PROBABILITY THEORY AND RELATED FIELDS, 2012, 154 (1-2) :193-224
[2]   Risk Factor Identification in Heterogeneous Disease Progression with L1-Regularized Multi-state Models [J].
Dang, Xuan ;
Huang, Shuai ;
Qian, Xiaoning .
JOURNAL OF HEALTHCARE INFORMATICS RESEARCH, 2021, 5 (01) :20-53
[3]   Efficient Global Approximation of Generalized Nonlinear l1-Regularized Solution Paths and Its Applications [J].
Yuan, Ming ;
Zou, Hui .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2009, 104 (488) :1562-1574
[4]   Tuning parameter calibration for l1-regularized logistic regression [J].
Li, Wei ;
Lederer, Johannes .
JOURNAL OF STATISTICAL PLANNING AND INFERENCE, 2019, 202 :80-98
[5]   Fast Estimation of L1-Regularized Linear Models in the Mass-Univariate Setting [J].
Mohr, Holger ;
Ruge, Hannes .
NEUROINFORMATICS, 2021, 19 (03) :385-392
[6]   Occlusion Handling with l1-Regularized Sparse Reconstruction [J].
Li, Wei ;
Li, Bing ;
Zhang, Xiaoqin ;
Hu, Weiming ;
Wang, Hanzi ;
Luo, Guan .
COMPUTER VISION - ACCV 2010, PT IV, 2011, 6495 :630-+
[7]   Stochastic Methods for l1-regularized Loss Minimization [J].
Shalev-Shwartz, Shai ;
Tewari, Ambuj .
JOURNAL OF MACHINE LEARNING RESEARCH, 2011, 12 :1865-1892
[8]   L1-regularized functional support vector machine [J].
Liu, Bingfan ;
Sang, Peijun .
STATISTICS AND ITS INTERFACE, 2024, 17 (03) :349-356
[9]   Sparsistency of l1-Regularized M-Estimators [J].
Li, Yen-Huan ;
Scarlett, Jonathan ;
Ravikumar, Pradeep ;
Cevher, Volkan .
ARTIFICIAL INTELLIGENCE AND STATISTICS, VOL 38, 2015, 38 :644-652
[10]   THE HOMOTOPY METHOD REVISITED: COMPUTING SOLUTION PATHS OF l1-REGULARIZED PROBLEMS [J].
Bringmann, Bjoern ;
Cremers, Daniel ;
Krahmer, Felix ;
Moeller, Michael .
MATHEMATICS OF COMPUTATION, 2018, 87 (313) :2343-2364