A variational Expectation-Maximization algorithm for temporal data clustering

被引:6
作者
El Assaad, Hani [1 ]
Same, Allou [1 ]
Govaert, Gerard [2 ]
Aknin, Patrice [1 ,3 ]
机构
[1] Univ Paris Est, IFSTTAR, GRETTIA, F-77447 Champs Sur Marne, France
[2] Univ Technol Compiegne, UMR CNRS Heudiasyc 7253, F-60205 Compiegne, France
[3] SNCF Res & Innovat, F-75012 Paris, France
关键词
Temporal data clustering; Dynamic latent variable model; Mixture model; EM algorithm; Kalman filter; Clustering; Maximum likelihood; Variational approximation;
D O I
10.1016/j.csda.2016.05.007
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
The problem of temporal data clustering is addressed using a dynamic Gaussian mixture model. In addition to the missing clusters used in the classical Gaussian mixture model, the proposed approach assumes that the means of the Gaussian densities are latent variables distributed according to random walks. The parameters of the proposed algorithm are estimated by the maximum likelihood approach. However, the EM algorithm cannot be applied directly due to the complex structure of the model, and some approximations are required. Using a variational approximation, an algorithm called VEM-DyMix is proposed to estimate the parameters of the proposed model. Using simulated data, the ability of the proposed approach to accurately estimate the parameters is demonstrated. VEM-DyMix outperforms, in terms of clustering and estimation accuracy, other state-of-the-art algorithms. The experiments performed on real world data from two fields of application (railway condition monitoring and object tracking from videos) show the strong potential of the proposed algorithms. (C) 2016 Elsevier B.V. All rights reserved.
引用
收藏
页码:206 / 228
页数:23
相关论文
共 27 条
  • [1] [Anonymous], 1985, STAT ANAL FINITE MIX
  • [2] [Anonymous], ESTIMATION MODELE BL
  • [3] [Anonymous], 2005, Functional Data Analysis, DOI DOI 10.1111/J.1541-0420.2007.007431.X
  • [4] [Anonymous], ADV MEAN FIELD METHO
  • [5] [Anonymous], MOTION TRACKING IMAG
  • [6] [Anonymous], 1989, Structural Time Series Models and the Kalman Filter
  • [7] [Anonymous], WILEY SERIES SURVEY
  • [8] Kalman filter mixture model for spike sorting of non-stationary data
    Calabrese, Ana
    Paninski, Liam
    [J]. JOURNAL OF NEUROSCIENCE METHODS, 2011, 196 (01) : 159 - 169
  • [9] MAXIMUM LIKELIHOOD FROM INCOMPLETE DATA VIA EM ALGORITHM
    DEMPSTER, AP
    LAIRD, NM
    RUBIN, DB
    [J]. JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-METHODOLOGICAL, 1977, 39 (01): : 1 - 38
  • [10] A MAXIMUM-LIKELIHOOD METHODOLOGY FOR CLUSTERWISE LINEAR-REGRESSION
    DESARBO, WS
    CRON, WL
    [J]. JOURNAL OF CLASSIFICATION, 1988, 5 (02) : 249 - 282