An expectation-maximization algorithm for the matrix normal distribution with an application in remote sensing

被引:24
作者
Glanz, Hunter [1 ]
Carvalho, Luis [2 ]
机构
[1] Calif Polytech State Univ San Luis Obispo, Dept Stat, San Luis Obispo, CA 93407 USA
[2] Boston Univ, Dept Math & Stat, Boston, MA 02215 USA
关键词
Kronecker covariance structure; Missing data imputation; MULTIVARIATE REPEATED-MEASURES; MISSING-DATA; MAXIMUM-LIKELIHOOD; COVARIANCE-MATRIX; EM ALGORITHM; MODELS; SEPARABILITY; MODIS;
D O I
10.1016/j.jmva.2018.03.010
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
Dramatic increases in the size and dimensionality of many modern datasets make crucial the need for sophisticated methods that can exploit inherent structure and handle missing values. In this article we derive an expectation-maximization (EM) algorithm for the matrix normal distribution, a distribution well-suited for naturally structured data such as spatio-temporal data. We review previously established maximum likelihood matrix normal estimates, and then consider the situation involving missing data. We apply our EM method in a simulation study exploring errors across different dimensions and proportions of missing data. We compare these errors to those from three alternative methods and show that our proposed EM method outperforms them in all scenarios. Finally, we implement the proposed EM method in a novel way on a satellite image dataset to investigate land-cover classification separability. (C) 2018 Elsevier Inc. All rights reserved.
引用
收藏
页码:31 / 48
页数:18
相关论文
共 31 条
[1]   TRANSPOSABLE REGULARIZED COVARIANCE MODELS WITH AN APPLICATION TO MISSING DATA IMPUTATION [J].
Allen, Genevera I. ;
Tibshirani, Robert .
ANNALS OF APPLIED STATISTICS, 2010, 4 (02) :764-790
[2]  
[Anonymous], 2014, STAT ANAL MISSING DA
[3]   SCHEFFE MIXED MODEL FOR MULTIVARIATE REPEATED MEASURES - A RELATIVE EFFICIENCY EVALUATION [J].
BOIK, RJ .
COMMUNICATIONS IN STATISTICS-THEORY AND METHODS, 1991, 20 (04) :1233-1255
[4]   Analysis of multivariate longitudinal data using quasi-least squares [J].
Chaganty, NR ;
Naik, DN .
JOURNAL OF STATISTICAL PLANNING AND INFERENCE, 2002, 103 (1-2) :421-436
[5]   THE ORIGINS OF KRIGING [J].
CRESSIE, N .
MATHEMATICAL GEOLOGY, 1990, 22 (03) :239-252
[6]  
DAWID AP, 1981, BIOMETRIKA, V68, P265, DOI 10.1093/biomet/68.1.265
[7]   MAXIMUM LIKELIHOOD FROM INCOMPLETE DATA VIA EM ALGORITHM [J].
DEMPSTER, AP ;
LAIRD, NM ;
RUBIN, DB .
JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-METHODOLOGICAL, 1977, 39 (01) :1-38
[8]   The MLE algorithm for the matrix normal distribution [J].
Dutilleul, P .
JOURNAL OF STATISTICAL COMPUTATION AND SIMULATION, 1999, 64 (02) :105-123
[9]   MODIS Collection 5 global land cover: Algorithm refinements and characterization of new datasets [J].
Friedl, Mark A. ;
Sulla-Menashe, Damien ;
Tan, Bin ;
Schneider, Annemarie ;
Ramankutty, Navin ;
Sibley, Adam ;
Huang, Xiaoman .
REMOTE SENSING OF ENVIRONMENT, 2010, 114 (01) :168-182
[10]   Testing for separability of spatial-temporal covariance functions [J].
Fuentes, M .
JOURNAL OF STATISTICAL PLANNING AND INFERENCE, 2006, 136 (02) :447-466