Consistency of the maximum likelihood estimator in seasonal hidden Markov models

被引:5
作者
Touron, Augustin [1 ,2 ]
机构
[1] Univ Paris Saclay, Univ Paris Sud, CNRS, Lab Math Orsay, F-91405 Orsay, France
[2] EDF R&D, 6 Quai Watier, F-78400 Chatou, France
关键词
Hidden Markov models; Climate modelling; Identifiability; Maximum likelihood; PROBABILISTIC FUNCTIONS; INFERENCE;
D O I
10.1007/s11222-019-09854-4
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
In this paper, we introduce a variant of hidden Markov models in which the transition probabilities between the states, as well as the emission distributions, are not constant in time but vary in a periodic manner. This class of models, which we will call seasonal hidden Markov models (SHMMs), is particularly useful in practice, as many applications involve a seasonal behaviour. However, up to now, there is no theoretical result regarding this kind of model. We show that under mild assumptions, SHMMs are identifiable: we can identify the transition matrices and the emission distributions from the joint distribution of the observations on a period, up to state labelling. We also give sufficient conditions for the strong consistency of the maximum likelihood estimator (MLE). These results are applied to simulated data, using the EM algorithm to compute the MLE. Finally, we show how SHMM can be used in real-world applications by applying our model to precipitation data, with mixtures of exponential distributions as emission distributions.
引用
收藏
页码:1055 / 1075
页数:21
相关论文
共 25 条
[1]   Nonparametric identification and maximum likelihood estimation for hidden Markov models [J].
Alexandrovich, G. ;
Holzmann, H. ;
Leister, A. .
BIOMETRIKA, 2016, 103 (02) :423-434
[2]   IDENTIFIABILITY OF PARAMETERS IN LATENT STRUCTURE MODELS WITH MANY OBSERVED VARIABLES [J].
Allman, Elizabeth S. ;
Matias, Catherine ;
Rhode, John A. .
ANNALS OF STATISTICS, 2009, 37 (6A) :3099-3132
[3]  
[Anonymous], 1983, DATA ANAL INFORM
[4]  
[Anonymous], 2016, Journal of Machine Learning Research
[5]   STATISTICAL INFERENCE FOR PROBABILISTIC FUNCTIONS OF FINITE STATE MARKOV CHAINS [J].
BAUM, LE ;
PETRIE, T .
ANNALS OF MATHEMATICAL STATISTICS, 1966, 37 (06) :1554-&
[6]   A MAXIMIZATION TECHNIQUE OCCURRING IN STATISTICAL ANALYSIS OF PROBABILISTIC FUNCTIONS OF MARKOV CHAINS [J].
BAUM, LE ;
PETRIE, T ;
SOULES, G ;
WEISS, N .
ANNALS OF MATHEMATICAL STATISTICS, 1970, 41 (01) :164-&
[7]   Choosing starting values for the EM algorithm for getting the highest likelihood in multivariate Gaussian mixture models [J].
Biernacki, C ;
Celeux, G ;
Govaert, G .
COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2003, 41 (3-4) :561-575
[8]  
Cappe Olivier, 2009, P EUSFLAT C, P14
[9]   Consistent Estimation of the Filtering and Marginal Smoothing Distributions in Nonparametric Hidden Markov Models [J].
De Castro, Yohann ;
Gassiat, Elisabeth ;
Le Corff, Sylvain .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2017, 63 (08) :4758-4777
[10]   MAXIMUM LIKELIHOOD FROM INCOMPLETE DATA VIA EM ALGORITHM [J].
DEMPSTER, AP ;
LAIRD, NM ;
RUBIN, DB .
JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-METHODOLOGICAL, 1977, 39 (01) :1-38