Robust maximum-likelihood parameter estimation of stochastic state-space systems based on EM algorithm

被引:1
作者
Zhong LushengNational Laboratory of Industrial Control TechnologyInstitute of Industrial Process ControlZhejiang UniversityHangzhou China [310027 ]
机构
关键词
parameter estimation; system identification; maximum likelihood(ML); stochastic state-space system; EM algorithm;
D O I
暂无
中图分类号
O212 [数理统计];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
This paper addresses the problems of parameter estimation of multivariable stationary stochastic systems on the basis of observed output data.The main contribution is to employ the expectation-maximisation(EM)method as a means for computation of the maximum-likelihood(ML)parameter estimation of the system.Closed form of the expectation of the studied system subjected to Gaussian distribution noise is derived and parameter choice that maximizes the expectation is also proposed.This results in an iterative algorithm for parameter estimation and the robust algorithm implementation based on technique of QR-factorization and Cholesky factorization is also discussed.Moreover,algorithmic properties such as non-decreasing likelihood value,necessary and sufficient conditions for the algorithm to arrive at a local stationary parameter,the convergence rate and the factors affecting the convergence rate are analyzed.Simulation study shows that the proposed algorithm has attractive properties such as numerical stability,and avoidance of difficult initial conditions.
引用
收藏
页码:1095 / 1103
页数:9
相关论文
共 50 条
[41]   A novel maximum likelihood-based stochastic gradient algorithm for Hammerstein nonlinear systems with coloured noise [J].
Pu, Yan ;
Chen, Jing .
INTERNATIONAL JOURNAL OF MODELLING IDENTIFICATION AND CONTROL, 2019, 32 (01) :23-29
[42]   Maximum likelihood parameter estimation algorithm for controlled autoregressive autoregressive models [J].
Wang, Wei ;
Li, Junhong ;
Ding, Ruifeng .
INTERNATIONAL JOURNAL OF COMPUTER MATHEMATICS, 2011, 88 (16) :3458-3467
[43]   Parameter estimation algorithm for state space systems with time-delay based on the iterative identification [J].
Gu, Ya ;
Liu, Jicheng ;
Zhu, Peiyi ;
Chou, Yongxin .
PROCEEDINGS OF 2018 10TH INTERNATIONAL CONFERENCE ON MODELLING, IDENTIFICATION AND CONTROL (ICMIC), 2018,
[44]   Evaluating the performance of a successive-approximations approach to parameter optimization in maximum-likelihood phylogeny estimation [J].
Sullivan, J ;
Abdo, Z ;
Joyce, P ;
Swofford, DL .
MOLECULAR BIOLOGY AND EVOLUTION, 2005, 22 (06) :1386-1392
[45]   A stochastic EM algorithm for nonlinear state estimation with model uncertainties [J].
Zia, A ;
Kirubarajan, T ;
Reilly, JP ;
Shirani, S .
SIGNAL AND DATA PROCESSING OF SMALL TARGETS 2003, 2003, 5204 :293-304
[46]   USE OF THE EM ALGORITHM FOR MAXIMUM-LIKELIHOOD-ESTIMATION IN ELECTRON-MICROSCOPE AUTORADIOGRAPHY [J].
AYKROYD, RG ;
ANDERSON, CW .
BIOMETRIKA, 1994, 81 (01) :41-52
[47]   Multi-innovation gradient parameter estimation for multivariable systems based on the maximum likelihood principle [J].
Xia, Huafeng ;
Xu, Sheng ;
Zhou, Cheng ;
Chen, Feiyan .
OPTIMAL CONTROL APPLICATIONS & METHODS, 2022, 43 (01) :106-122
[48]   Parameter estimation in general state-space models using particle methods [J].
Doucet, A ;
Tadic, VB .
ANNALS OF THE INSTITUTE OF STATISTICAL MATHEMATICS, 2003, 55 (02) :409-422
[49]   An algorithm for non-parametric estimation in state-space models [J].
Thi Tuyet Trang Chau ;
Ailliot, Pierre ;
Monbet, Valerie .
COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2021, 153
[50]   Parameter estimation in general state-space models using particle methods [J].
Arnaud Doucet ;
Vladislav B. Tadić .
Annals of the Institute of Statistical Mathematics, 2003, 55 :409-422