A new type of parameter estimation algorithm for missing data problems

被引:9
作者
Stoica, P
Xu, LZ
Li, J
机构
[1] Univ Florida, Dept Elect & Comp Engn, Gainesville, FL 32611 USA
[2] Uppsala Univ, Dept Informat Technol, Uppsala, Sweden
基金
美国国家科学基金会;
关键词
parameter estimation with missing data; maximum likelihood; expectation-maximization; cyclic maximization;
D O I
10.1016/j.spl.2005.05.018
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
The expectation-maximization (EM) algorithm is often used in maximum likelihood (ML) estimation problems with missing data. However, EM can be rather slow to converge. In this communication we introduce a new algorithm for parameter estimation problems with missing data, which we call equalization-maximization (EqM) (for reasons to be explained later). We derive the EqM algorithm in a general context and illustrate its use in the specific case of Gaussian autoregressive time series with a varying amount of missing observations. In the presented examples, EqM outperforms EM in terms of computational speed, at a comparable estimation performance. (c) 2005 Elsevier B.V. All rights reserved.
引用
收藏
页码:219 / 229
页数:11
相关论文
共 11 条
[1]   EXACT MAXIMUM-LIKELIHOOD PARAMETER-ESTIMATION OF SUPERIMPOSED EXPONENTIAL SIGNALS IN NOISE [J].
BRESLER, Y ;
MACOVSKI, A .
IEEE TRANSACTIONS ON ACOUSTICS SPEECH AND SIGNAL PROCESSING, 1986, 34 (05) :1081-1089
[2]   MAXIMUM LIKELIHOOD FROM INCOMPLETE DATA VIA EM ALGORITHM [J].
DEMPSTER, AP ;
LAIRD, NM ;
RUBIN, DB .
JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-METHODOLOGICAL, 1977, 39 (01) :1-38
[3]   IDENTIFICATION OF ARX-MODELS SUBJECT TO MISSING DATA [J].
ISAKSSON, AJ .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 1993, 38 (05) :813-819
[4]   Comparative study of IQML and MODE direction-of-arrival estimators [J].
Li, J ;
Stoica, P ;
Liu, ZS .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 1998, 46 (01) :149-160
[5]  
Little Roderick J.A., 2019, Statistical analysis with missing data, V793, DOI DOI 10.1002
[6]   PARAMETER-ESTIMATION FOR AUTO-REGRESSIVE SYSTEMS WITH MISSING OBSERVATIONS [J].
MCGIFFIN, PB ;
MURTHY, DNP .
INTERNATIONAL JOURNAL OF SYSTEMS SCIENCE, 1980, 11 (09) :1021-1034
[7]  
McLachlan G. J., 1997, EM ALGORITHM EXTENSI
[8]  
MILLER RB, 1984, TIME SERIES ANAL IRR, P251
[9]  
Sargan J., 1974, INT ECON REV, V15, P39
[10]   On the inconsistency of IQML [J].
Stoica, P ;
Li, JA ;
Soderstrom, T .
SIGNAL PROCESSING, 1997, 56 (02) :185-190