In-Network Online Asynchronous Regression Over a Wireless Network

被引:0
作者
Meshram, Rahul H. [1 ]
机构
[1] Indian Inst Technol, Dept Elect Engn, Bombay 400076, Maharashtra, India
来源
2014 TWENTIETH NATIONAL CONFERENCE ON COMMUNICATIONS (NCC) | 2014年
关键词
distributed algorithms; in-network computation; regression; backpropagation; stochastic approximation; wireless networks; SENSOR NETWORKS; ALGORITHMS; MODELS;
D O I
暂无
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
We consider online in-network regression over wireless networks. We model the distributed regression as a least square problem and perform the computation over an overlay computational structure that is identical to the multilayer backpropagation of neural networks. The overlay is aligned to the physical topology of the network. The sources of the explanatory (input) and response (output) variables are assumed distributed. Since the wireless network imposes constraints on the allowable simultaneous transmissions, the updates to the estimates of the regression coefficients are necessarily asynchronous. The scheme is analyzed as a stochastic gradient descent algorithm. We also propose the scheduling scheme which respects wireless constraints and dynamically chooses the message passing sequence to speed up the rate of convergence of algorithm. We demonstrate our algorithm performance via numerical results.
引用
收藏
页数:6
相关论文
共 18 条
[1]  
Bertsekas D. P., 1997, Parallel and Distributed Computation: Numerical Methods
[2]  
Borkar VS., 2009, Stochastic Approximation: A Dynamical Systems Viewpoint
[3]   Distributed fusion in sensor networks -: A graphical models perspective [J].
Cetin, Mujdat ;
Chen, Lei ;
Fisher, John W., III ;
Ihler, Alexander T. ;
Moses, Randolph L. ;
Wainwright, Martin J. ;
Willsky, Alan S. .
IEEE SIGNAL PROCESSING MAGAZINE, 2006, 23 (04) :42-55
[4]  
Cruz F. P., 2010, IEEE SIGNAL PROCESSI, V17, P355
[5]  
Forero PA, 2010, J MACH LEARN RES, V11, P1663
[6]  
Guestrin C., 2004, P 3 IPSN
[7]  
Honiene P., 2008, P IEEE GLOB
[8]   A Distributed CSMA Algorithm for Throughput and Utility Maximization in Wireless Networks [J].
Jiang, Libin ;
Walrand, Jean .
IEEE-ACM TRANSACTIONS ON NETWORKING, 2010, 18 (03) :960-972
[9]   Distributed Sparse Linear Regression [J].
Mateos, Gonzalo ;
Bazerque, Juan Andres ;
Giannakis, Georgios B. .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2010, 58 (10) :5262-5276
[10]  
Predd J. B., 2006, P INF TH WORKSH