Diffusion-Based EM Algorithm for Distributed Estimation of Gaussian Mixtures in Wireless Sensor Networks

被引:28
作者
Weng, Yang [2 ]
Xiao, Wendong [1 ]
Xie, Lihua [3 ]
机构
[1] Inst Infocomm Res, Singapore 138632, Singapore
[2] Sichuan Univ, Sch Math, Chengdu 610064, Peoples R China
[3] Nanyang Technol Univ, Sch Elect & Elect Engn, Singapore 639798, Singapore
基金
中国国家自然科学基金;
关键词
diffusion; distributed processing; EM algorithm; consensus; wireless sensor networks; LEAST-MEAN SQUARES; STRATEGIES; OPTIMIZATION; FORMULATION; TRACKING;
D O I
10.3390/s110606297
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Distributed estimation of Gaussian mixtures has many applications in wireless sensor network (WSN), and its energy-efficient solution is still challenging. This paper presents a novel diffusion-based EM algorithm for this problem. A diffusion strategy is introduced for acquiring the global statistics in EM algorithm in which each sensor node only needs to communicate its local statistics to its neighboring nodes at each iteration. This improves the existing consensus-based distributed EM algorithm which may need much more communication overhead for consensus, especially in large scale networks. The robustness and scalability of the proposed approach can be achieved by distributed processing in the networks. In addition, we show that the proposed approach can be considered as a stochastic approximation method to find the maximum likelihood estimation for Gaussian mixtures. Simulation results show the efficiency of this approach.
引用
收藏
页码:6297 / 6316
页数:20
相关论文
共 29 条
[1]   Wireless sensor networks: a survey [J].
Akyildiz, IF ;
Su, W ;
Sankarasubramaniam, Y ;
Cayirci, E .
COMPUTER NETWORKS, 2002, 38 (04) :393-422
[2]  
[Anonymous], 1979, Computers and Intractablity: A Guide to the Theory of NP-Completeness
[3]  
Bilmes J., GENTLE TUTORIAL EM A
[4]   Communication constraints in the average consensus problem [J].
Carli, Ruggero ;
Fagnani, Fabio ;
Speranzon, Alberto ;
Zampieri, Sandro .
AUTOMATICA, 2008, 44 (03) :671-684
[5]   Diffusion recursive least-squares for distributed estimation over adaptive networks [J].
Cattivelli, Federico S. ;
Lopes, Cassio G. ;
Sayed, Ali. H. .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2008, 56 (05) :1865-1877
[6]   Distributed Detection Over Adaptive Networks Using Diffusion Adaptation [J].
Cattivelli, Federico S. ;
Sayed, Ali H. .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2011, 59 (05) :1917-1932
[7]   Diffusion Strategies for Distributed Kalman Filtering and Smoothing [J].
Cattivelli, Federico S. ;
Sayed, Ali H. .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2010, 55 (09) :2069-2084
[8]   Diffusion LMS Strategies for Distributed Estimation [J].
Cattivelli, Federico S. ;
Sayed, Ali H. .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2010, 58 (03) :1035-1048
[9]   MAXIMUM LIKELIHOOD FROM INCOMPLETE DATA VIA EM ALGORITHM [J].
DEMPSTER, AP ;
LAIRD, NM ;
RUBIN, DB .
JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-METHODOLOGICAL, 1977, 39 (01) :1-38
[10]   Distributed EM algorithm for Gaussian mixtures in sensor networks [J].
Gu, Dongbing .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 2008, 19 (07) :1154-1166