Robust maximum-likelihood parameter estimation of stochastic state-space systems based on EM algorithm

被引:1
作者
Zhong Lusheng(National Laboratory of Industrial Control Technology
机构
基金
中国国家自然科学基金;
关键词
parameter estimation; system identification; maximum likelihood(ML); stochastic state-space system; EM algorithm;
D O I
暂无
中图分类号
O212 [数理统计];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
This paper addresses the problems of parameter estimation of multivariable stationary stochastic systems on the basis of observed output data.The main contribution is to employ the expectation-maximisation(EM)method as a means for computation of the maximum-likelihood(ML)parameter estimation of the system.Closed form of the expectation of the studied system subjected to Gaussian distribution noise is derived and parameter choice that maximizes the expectation is also proposed.This results in an iterative algorithm for parameter estimation and the robust algorithm implementation based on technique of QR-factorization and Cholesky factorization is also discussed.Moreover,algorithmic properties such as non-decreasing likelihood value,necessary and sufficient conditions for the algorithm to arrive at a local stationary parameter,the convergence rate and the factors affecting the convergence rate are analyzed.Simulation study shows that the proposed algorithm has attractive properties such as numerical stability,and avoidance of difficult initial conditions.
引用
收藏
页码:1095 / 1103
页数:9
相关论文
共 50 条
[31]   Gradient Parameter Estimation of a Class of Nonlinear Systems Based on the Maximum Likelihood Principle [J].
Zhang, Chen ;
Liu, Haibo ;
Ji, Yan .
INTERNATIONAL JOURNAL OF CONTROL AUTOMATION AND SYSTEMS, 2022, 20 (05) :1393-1404
[32]   Gradient Parameter Estimation of a Class of Nonlinear Systems Based on the Maximum Likelihood Principle [J].
Chen Zhang ;
Haibo Liu ;
Yan Ji .
International Journal of Control, Automation and Systems, 2022, 20 :1393-1404
[33]   Maximum Likelihood Identification of Countercurrent Rare Earth Extraction Process Based on State-space Model [J].
Zhong Lusheng ;
Fan Xiaoping ;
Yang Hui .
PROCEEDINGS OF THE 29TH CHINESE CONTROL CONFERENCE, 2010, :1426-1430
[34]   Newton-based maximum likelihood estimation in nonlinear state space models [J].
Kok, Manon ;
Dahlin, Johan ;
Schon, Thomas B. ;
Wills, Adrian .
IFAC PAPERSONLINE, 2015, 48 (28) :398-403
[35]   Maximum-likelihood estimation, the Cramer-Rao bound, and the method of scoring with, parameter constraints [J].
Moore, Terrence J. ;
Sadler, Brian M. ;
Kozick, Richard J. .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2008, 56 (03) :895-908
[36]   The evolution of codon preferences in Drosophila:: A maximum-likelihood approach to parameter estimation and hypothesis testing [J].
McVean, GAT ;
Vieira, J .
JOURNAL OF MOLECULAR EVOLUTION, 1999, 49 (01) :63-75
[37]   Conditional maximum-likelihood estimation in probability-based multistage designs [J].
Steinfeld J. ;
Robitzsch A. .
Behaviormetrika, 2024, 51 (2) :617-634
[38]   A note on multinomial maximum likelihood estimation under ordered restrictions and the EM algorithm [J].
Li, Yuling ;
Gao, Wei ;
Shi, Ning-Zhong .
METRIKA, 2007, 66 (01) :105-114
[39]   A note on multinomial maximum likelihood estimation under ordered restrictions and the EM algorithm [J].
Yuling Li ;
Wei Gao ;
Ning-Zhong Shi .
Metrika, 2007, 66 :105-114
[40]   A novel maximum likelihood-based stochastic gradient algorithm for Hammerstein nonlinear systems with coloured noise [J].
Pu, Yan ;
Chen, Jing .
INTERNATIONAL JOURNAL OF MODELLING IDENTIFICATION AND CONTROL, 2019, 32 (01) :23-29