Asymptotic Theory of l1-Regularized PDE Identification from a Single Noisy Trajectory

被引:4
作者
He, Yuchen [1 ]
Suh, Namjoon [2 ]
Huo, Xiaoming [2 ]
Kang, Sung Ha [3 ]
Mei, Yajun [2 ]
机构
[1] Shanghai Jiao Tong Univ, Inst Nat Sci, Shanghai, Peoples R China
[2] Georgia Inst Technol, Sch Ind & Syst Engn, Atlanta, GA 30332 USA
[3] Georgia Inst Technol, Sch Math, Atlanta, GA 30332 USA
关键词
parital differential equation (PDE); lasso; pseudo least square; signed-support recovery; primal-dual witness construction; local-polynomial regression; STRONG UNIFORM CONSISTENCY; UNCERTAINTY PRINCIPLES; VARIABLE SELECTION; REGRESSION; RECOVERY; REPRESENTATIONS; EQUATIONS; MODELS; RATES; WEAK;
D O I
10.1137/21M1398884
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
We provide a formal theoretical analysis on the PDE identification via the '1-regularized pseudo least square method from the statistical point of view. In this article, we assume that the differential equation governing the dynamic system can be represented as a linear combination of various linear and nonlinear differential terms. Under noisy observations, we employ local-polynomial fitting for estimating state variables and apply the '1 penalty for model selection. Our theory proves that the classical mutual incoherence condition on the feature matrix F and the beta* min-condition for the ground-truth signal beta* are sufficient for the signed-support recovery of the '1-PsLS method. We run numerical experiments on two popular PDE models, the viscous Burgers and the Korteweg-de Vries (KdV) equations, and the results from the experiments corroborate our theoretical predictions.
引用
收藏
页码:1012 / 1036
页数:25
相关论文
共 45 条
  • [21] CONSISTENCY OF l1-REGULARIZED MAXIMUM-LIKELIHOOD FOR COMPRESSIVE POISSON REGRESSION
    Li, Yen-Huan
    Cevher, Volkan
    2015 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING (ICASSP), 2015, : 3606 - 3610
  • [22] An algorithm for quadratic l1-regularized optimization with a flexible active-set strategy
    Solntsev, Stefan
    Nocedal, Jorge
    Byrd, Richard H.
    OPTIMIZATION METHODS & SOFTWARE, 2015, 30 (06) : 1213 - 1237
  • [23] Fast Estimation of L1-Regularized Linear Models in the Mass-Univariate Setting
    Holger Mohr
    Hannes Ruge
    Neuroinformatics, 2021, 19 : 385 - 392
  • [24] A Fast Hybrid Algorithm for Large-Scale l1-Regularized Logistic Regression
    Shi, Jianing
    Yin, Wotao
    Osher, Stanley
    Sajda, Paul
    JOURNAL OF MACHINE LEARNING RESEARCH, 2010, 11 : 713 - 741
  • [25] AN L1-REGULARIZED NAIVE BAYES-INSPIRED CLASSIFIER FOR DISCARDING REDUNDANT AND IRRELEVANT PREDICTORS
    Vidaurre, Diego
    Bielza, Concha
    Larranaga, Pedro
    INTERNATIONAL JOURNAL ON ARTIFICIAL INTELLIGENCE TOOLS, 2013, 22 (04)
  • [26] A Comparison of Optimization Methods and Software for Large-scale L1-regularized Linear Classification
    Yuan, Guo-Xun
    Chang, Kai-Wei
    Hsieh, Cho-Jui
    Lin, Chih-Jen
    JOURNAL OF MACHINE LEARNING RESEARCH, 2010, 11 : 3183 - 3234
  • [27] Ising model selection using l1-regularized linear regression: a statistical mechanics analysis
    Meng, Xiangming
    Obuchi, Tomoyuki
    Kabashima, Yoshiyuki
    JOURNAL OF STATISTICAL MECHANICS-THEORY AND EXPERIMENT, 2022, 2022 (11):
  • [28] Ising Model Selection Using l1-Regularized Linear Regression: A Statistical Mechanics Analysis
    Meng, Xiangming
    Obuchi, Tomoyuki
    Kabashima, Yoshiyuki
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [29] Rank-based estimation in the l1-regularized partly linear model for censored outcomes with application to integrated analyses of clinical predictors and gene expression data
    Johnson, Brent A.
    BIOSTATISTICS, 2009, 10 (04) : 659 - 666
  • [30] An MM-Based Algorithm for l1-Regularized Least-Squares Estimation With an Application to Ground Penetrating Radar Image Reconstruction
    Ndoye, Mandoye
    Anderson, John M. M.
    Greene, David J.
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2016, 25 (05) : 2206 - 2221