Robust Estimation of Multivariate Location and Scatter in the Presence of Missing Data

被引:18
作者
Danilov, Mike [1 ]
Yohai, Victor J. [2 ]
Zamar, Ruben H. [3 ]
机构
[1] Google, Mountain View, CA 94043 USA
[2] Univ Buenos Aires, Fac Ciencias Exactas & Nat, Dept Matemat, RA-1428 Buenos Aires, DF, Argentina
[3] Univ British Columbia, Dept Stat, Vancouver, BC V6T 1Z2, Canada
基金
加拿大自然科学与工程研究理事会;
关键词
Consistent; Elliptical distribution; EM algorithm; Fixed point equation; LIKELIHOOD; IMPUTATION; COVARIANCE; SHAPE;
D O I
10.1080/01621459.2012.699792
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
Two main issues regarding data quality are data contamination (outliers) and data completion (missing data). These two problems have attracted much attention and research but surprisingly, they are seldom considered together. Popular robust methods such as S-estimators of multivariate location and scatter offer protection against outliers but cannot deal with missing data, except for the obviously inefficient approach of deleting all incomplete cases. We generalize the definition of S-estimators of multivariate location and scatter to simultaneously deal with missing data and outliers. We show that the proposed estimators are strongly consistent under elliptical models when data are missing completely at random. We derive an algorithm similar to the Expectation-Maximization algorithm for computing the proposed estimators. This algorithm is initialized by an extension for missing data of the minimum volume ellipsoid. We assess the performance of our proposal by Monte Carlo simulation and give some real data examples. This article has supplementary material online.
引用
收藏
页码:1178 / 1186
页数:9
相关论文
共 24 条
[1]  
[Anonymous], 1985, MATH STAT APPL, V8, P283, DOI DOI 10.1007/978-94-009-5438-0_20
[2]   High-breakdown estimation of multivariate mean and covariance with missing observations [J].
Cheng, TC ;
Victoria-Feser, MP .
BRITISH JOURNAL OF MATHEMATICAL & STATISTICAL PSYCHOLOGY, 2002, 55 :317-335
[3]  
Copt S., 2003, 200304 U GEN
[4]  
Croux C, 2008, STAT SINICA, V18, P581
[5]  
Danilov M., 2010, THESIS U BRIT COLUMB
[7]   MAXIMUM LIKELIHOOD FROM INCOMPLETE DATA VIA EM ALGORITHM [J].
DEMPSTER, AP ;
LAIRD, NM ;
RUBIN, DB .
JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-METHODOLOGICAL, 1977, 39 (01) :1-38
[8]   A generalization of Tyler's M-estimators to the case of incomplete data [J].
Frahm, Gabriel ;
Jaekel, Uwe .
COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2010, 54 (02) :374-393
[9]   HEDONIC HOUSING PRICES AND DEMAND FOR CLEAN-AIR [J].
HARRISON, D ;
RUBINFELD, DL .
JOURNAL OF ENVIRONMENTAL ECONOMICS AND MANAGEMENT, 1978, 5 (01) :81-102
[10]  
Kenward MG, 1998, STAT SCI, V13, P236