A Fault Tolerant Peer-to-Peer Distributed EM Algorithm

被引:3
作者
Safarinejadian, Behrooz [1 ]
Menhaj, Mohammad B. [1 ]
Karrari, Mehdi [1 ]
机构
[1] Amirkabir Univ Technol, Dept Elect Engn, Tehran, Iran
来源
2009 IEEE SYMPOSIUM ON COMPUTATIONAL INTELLIGENCE AND DATA MINING | 2009年
关键词
D O I
10.1109/CIDM.2009.4938628
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, a distributed Expectation Maximization (EM) algorithm is proposed for estimating parameters of a Gaussian mixture model in a peer-to-peer network. This algorithm is used for density estimation and clustering of data distributed over nodes of a network. Scalability and fault tolerance are two important advantages of this method. In the E-step of this algorithm, each node calculates local sufficient statistics using its local observations. A peer-to-peer algorithm is then used to diffuse local sufficient statistics to neighboring nodes and estimate global sufficient statistics in each node. In the M-step, each node updates parameters of the Gaussian mixture model using the estimated global sufficient statistics. The proposed method is then used for environmental monitoring and also distributed target classification. Simulation results approve promising performance of this algorithm.
引用
收藏
页码:46 / 52
页数:7
相关论文
共 16 条
[1]  
BESG J, 1986, J ROYAL STAT SOC B, V48, P259
[2]   Collective mining of Bayesian networks from distributed heterogeneous data [J].
Chen, R ;
Sivakumar, K ;
Kargupta, H .
KNOWLEDGE AND INFORMATION SYSTEMS, 2004, 6 (02) :164-187
[3]  
Dasgupta S., 1999, Proceedings of the 40th Annual Symposium on Foundations of Computer Science, FOCS'99, page, V40, P634
[4]   Distributed data mining in peer-to-peer networks [J].
Datta, Souptik ;
Bhaduri, Kanishka ;
Giannella, Chris ;
Kargupta, Hillol ;
Wolff, Ran .
IEEE INTERNET COMPUTING, 2006, 10 (04) :18-26
[5]   MAXIMUM LIKELIHOOD FROM INCOMPLETE DATA VIA EM ALGORITHM [J].
DEMPSTER, AP ;
LAIRD, NM ;
RUBIN, DB .
JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-METHODOLOGICAL, 1977, 39 (01) :1-38
[6]  
GIANNELLA C, 2006, P INT WORKSH HIGH PE
[7]  
McLachlan G. J., 1997, EM ALGORITHM EXTENSI, P120
[8]  
NEAL R, 2001, LEARNING GRAPHICAL M, P355
[9]   Distributed EM algorithms for density estimation and clustering in sensor networks [J].
Nowak, RD .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2003, 51 (08) :2245-2253
[10]  
Ordonez C., 2002, Proceedings of the Eleventh International Conference on Information and Knowledge Management. CIKM 2002, P590, DOI 10.1145/584792.584889