Distributed Unsupervised Gaussian Mixture Learning for Density Estimation in Sensor Networks

被引:17
作者
Safarinejadian, Behrooz [1 ,2 ]
Menhaj, Mohammad B. [2 ]
Karrari, Mehdi [2 ]
机构
[1] Shiraz Univ Technol, Shiraz 71555313, Iran
[2] Amirkabir Univ Technol, Tehran 15914, Iran
关键词
Data clustering; density estimation; expectation maximization (EM) algorithm; sensor networks; unsupervised learning;
D O I
10.1109/TIM.2009.2036348
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
This paper considers the problem of density estimation and clustering in sensor networks. It is assumed that measurements of the sensors can statistically be modeled by a common Gaussian mixture model (GMM). In this paper, a distributed expectation maximization (DEM) algorithm is developed to estimate the model order and the parameters of this model. Scalability and fault tolerance are two important advantages of this method. In the E-step of this algorithm, each node calculates local sufficient statistics using its local observations. A distributed averaging approach is then used to diffuse local sufficient statistics to neighboring nodes and estimate global sufficient statistics in each node. In the M-step, each node updates parameters of the GMM using the estimated global sufficient statistics. Diffusion speed and convergence of the proposed algorithm are also studied. The proposed method is then used for environmental monitoring and also distributed target classification. Simulation results approve the promising performance of this algorithm.
引用
收藏
页码:2250 / 2260
页数:11
相关论文
共 38 条
  • [1] [Anonymous], 1999, Learning in Graphical Models
  • [2] Inference in model-based cluster analysis
    Bensmail, H
    Celeux, G
    Raftery, AE
    Robert, CP
    [J]. STATISTICS AND COMPUTING, 1997, 7 (01) : 1 - 10
  • [3] BESG J, 1986, J ROYAL STAT SOC B, V48, P259
  • [4] Boyd S, 2005, IEEE INFOCOM SER, P1653
  • [5] Collective mining of Bayesian networks from distributed heterogeneous data
    Chen, R
    Sivakumar, K
    Kargupta, H
    [J]. KNOWLEDGE AND INFORMATION SYSTEMS, 2004, 6 (02) : 164 - 187
  • [6] Cover T.M., 2006, ELEMENTS INFORM THEO, V2nd ed
  • [7] Dasgupta S., 1999, Proceedings of the 40th Annual Symposium on Foundations of Computer Science, FOCS'99, page, V40, P634
  • [8] Distributed data mining in peer-to-peer networks
    Datta, Souptik
    Bhaduri, Kanishka
    Giannella, Chris
    Kargupta, Hillol
    Wolff, Ran
    [J]. IEEE INTERNET COMPUTING, 2006, 10 (04) : 18 - 26
  • [9] MAXIMUM LIKELIHOOD FROM INCOMPLETE DATA VIA EM ALGORITHM
    DEMPSTER, AP
    LAIRD, NM
    RUBIN, DB
    [J]. JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-METHODOLOGICAL, 1977, 39 (01): : 1 - 38
  • [10] Epidemic information dissemination in distributed
    Eugster, PT
    Guerraoui, R
    Kermarrec, AM
    Massoulié, L
    [J]. COMPUTER, 2004, 37 (05) : 60 - +