REGULARIZED ESTIMATION IN HIGH-DIMENSIONAL VECTOR AUTO-REGRESSIVE MODELS USING SPATIO-TEMPORAL INFORMATION

被引:1
作者
Wang, Zhenzhong [1 ]
Safikhani, Abolfazl [2 ]
Zhu, Zhengyuan [1 ]
Matteson, David S. [3 ]
机构
[1] Iowa State Univ, Dept Stat, Ames, IA 50011 USA
[2] Univ Florida, Dept Stat, Gainesville, FL 32611 USA
[3] Cornell Univ, Dept Stat & Data Sci, Ithaca, NY 14853 USA
关键词
l1; regularization; spatio-temporal structure; vector auto-regressive model; weak sparsity; GENERALIZED LINEAR-MODELS; TIME-SERIES; REGRESSION; STABILITY; INFERENCE; SELECTION;
D O I
10.5705/ss.202020.0056
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
The vector auto-regressive (VAR) model is commonly used to model multivariate time series, and there are many penalized methods to handle high dimensionality. However for spatio-temporal data, most of these methods do not consider the spatial and temporal structure of the data, which may lead to unreliable network detection and inaccurate forecasts. This paper proposes a data-driven weighted l1 regularized approach for spatio-temporal VAR models. Extensive simulation studies compare the proposed method with five existing methods for high-dimensional VAR models, demonstrating advantages of our method over others in terms of parameter estimation, network detection, and out-of-sample forecasts. We also apply our method to a traffic data set to evaluate its performance in a real application. In addition, we explore the theoretical properties of the l1 regularized estimation of the VAR model under a weakly sparse scenario, in which exact sparsity can be viewed as a special case. To the best of our knowledge, this is the first study to do so. For a general stationary VAR process, we derive the nonasymptotic upper bounds on the l1 regularized estimation errors, provide the conditions for estimation consistency, and further simplify these conditions for a special VAR(1) case.
引用
收藏
页码:1271 / 1294
页数:24
相关论文
共 31 条
[1]   Sparse seasonal seasonal and periodic vector autoregressive modeling [J].
Baek, Changryong ;
Davis, Richard A. ;
Pipiras, Vladas .
COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2017, 106 :103-126
[2]   LARGE BAYESIAN VECTOR AUTO REGRESSIONS [J].
Banbura, Marta ;
Giannone, Domenico ;
Reichlin, Lucrezia .
JOURNAL OF APPLIED ECONOMETRICS, 2010, 25 (01) :71-92
[3]   Low Rank and Structured Modeling of High-Dimensional Vector Autoregressions [J].
Basu, Sumanta ;
Li, Xianqi ;
Michailidis, George .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2019, 67 (05) :1207-1222
[4]   REGULARIZED ESTIMATION IN SPARSE HIGH-DIMENSIONAL TIME SERIES MODELS [J].
Basu, Sumanta ;
Michailidis, George .
ANNALS OF STATISTICS, 2015, 43 (04) :1535-1567
[5]   Sparse Vector Autoregressive Modeling [J].
Davis, Richard A. ;
Zang, Pengfei ;
Zheng, Tian .
JOURNAL OF COMPUTATIONAL AND GRAPHICAL STATISTICS, 2016, 25 (04) :1077-1096
[6]   COMPARING PREDICTIVE ACCURACY [J].
DIEBOLD, FX ;
MARIANO, RS .
JOURNAL OF BUSINESS & ECONOMIC STATISTICS, 1995, 13 (03) :253-263
[7]   LOCAL POLYNOMIAL KERNEL REGRESSION FOR GENERALIZED LINEAR-MODELS AND QUASI-LIKELIHOOD FUNCTIONS [J].
FAN, JQ ;
HECKMAN, NE ;
WAND, MP .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 1995, 90 (429) :141-150
[8]   Regularization Paths for Generalized Linear Models via Coordinate Descent [J].
Friedman, Jerome ;
Hastie, Trevor ;
Tibshirani, Rob .
JOURNAL OF STATISTICAL SOFTWARE, 2010, 33 (01) :1-22
[9]   High-dimensional and banded vector autoregressions [J].
Guo, Shaojun ;
Wang, Yazhen ;
Yao, Qiwei .
BIOMETRIKA, 2016, 103 (04) :889-903
[10]   Quantifying effects of abiotic and biotic drivers on community dynamics with multivariate autoregressive (MAR) models [J].
Hampton, Stephanie E. ;
Holmes, Elizabeth E. ;
Scheef, Lindsay P. ;
Scheuerell, Mark D. ;
Katz, Stephen L. ;
Pendleton, Daniel E. ;
Ward, Eric J. .
ECOLOGY, 2013, 94 (12) :2663-2669