Penalized least squares approximation methods and their applications to stochastic processes

被引:9
|
作者
Suzuki, Takumi [1 ,2 ]
Yoshida, Nakahiro [1 ,2 ]
机构
[1] Univ Tokyo, Grad Sch Math Sci, Meguro Ku, 3-8-1 Komaba, Tokyo 1538914, Japan
[2] Japan Sci & Technol Agcy, CREST, Kawaguchi, Saitama, Japan
基金
日本学术振兴会; 日本科学技术振兴机构;
关键词
Variable selection; Least squares approximation; Cox process; Diffusion type process; QUASI-LIKELIHOOD ANALYSIS; ADAPTIVE LASSO; INEQUALITIES; SELECTION;
D O I
10.1007/s42081-019-00064-w
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
We construct an objective function that consists of a quadratic approximation term and an Lq penalty (0<q<less than or equal to>1) term. Thanks to the quadratic approximation, we can deal with various kinds of loss functions into a unified way, and by taking advantage of the Lq penalty term, we can simultaneously execute variable selection and parameter estimation. In this article, we show that our estimator has oracle properties, and even better property. We also treat stochastic processes as applications.
引用
收藏
页码:513 / 541
页数:29
相关论文
共 50 条
  • [31] A Two-Stage Penalized Least Squares Method for Constructing Large Systems of Structural Equations
    Chen, Chen
    Ren, Min
    Zhang, Min
    Zhang, Dabao
    JOURNAL OF MACHINE LEARNING RESEARCH, 2018, 19
  • [32] Penalized profile least squares-based statistical inference for varying coefficient partially linear errors-in-variables models
    Fan, Guo-liang
    Liang, Han-ying
    Zhu, Li-xing
    SCIENCE CHINA-MATHEMATICS, 2018, 61 (09) : 1677 - 1694
  • [33] Spatial partial least squares autoregression: Algorithm and applications
    Wang, Huiwen
    Gu, Jie
    Wang, Shanshan
    Saporta, Gilbert
    CHEMOMETRICS AND INTELLIGENT LABORATORY SYSTEMS, 2019, 184 : 123 - 131
  • [34] Fast General Norm Approximation via Iteratively Reweighted Least Squares
    Samejima, Masaki
    Matsushita, Yasuyuki
    COMPUTER VISION - ACCV 2016 WORKSHOPS, PT II, 2017, 10117 : 207 - 221
  • [35] Weighted least-squares approximation of FIR by IIR digital filters
    Brandenstein, H
    Unbehauen, R
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2001, 49 (03) : 558 - 568
  • [36] LEAST SQUARES APPROXIMATION OF POLYNOMIAL CHAOS EXPANSIONS WITH OPTIMIZED GRID POINTS
    Ghili, Saman
    Iaccarino, Gianluca
    SIAM JOURNAL ON SCIENTIFIC COMPUTING, 2017, 39 (05) : A1991 - A2019
  • [37] Fuzzy transform and least-squares approximation: Analogies, differences, and generalizations
    Patane, Giuseppe
    FUZZY SETS AND SYSTEMS, 2011, 180 (01) : 41 - 54
  • [38] Modified moving least squares with polynomial bases for scattered data approximation
    Joldes, Grand Roman
    Chowdhury, Habibullah Amin
    Wittek, Adam
    Doyle, Barry
    Miller, Karol
    APPLIED MATHEMATICS AND COMPUTATION, 2015, 266 : 893 - 902
  • [39] Penalized least-squares estimation for regression coefficients in high-dimensional partially linear models
    Ni, Huey-Fan
    JOURNAL OF STATISTICAL PLANNING AND INFERENCE, 2012, 142 (02) : 379 - 389
  • [40] Foundation of stochastic fractional calculus with fractional approximation of stochastic processes
    Anastassiou, George A.
    REVISTA DE LA REAL ACADEMIA DE CIENCIAS EXACTAS FISICAS Y NATURALES SERIE A-MATEMATICAS, 2020, 114 (02)