Asymptotic behavior of asynchronous stochastic approximation

被引：0
作者：
Haitao Fang
Hanfu Chen
机构：
[1] Academy of Mathematics and System Sciences,Laboratory of Systems and Control, Institute of Systems Science
[2] Chinese Academy of Sciences,undefined
来源：
Science in China Series : Information Sciences | 2001年 / 44卷 / 4期
关键词：
asynchronous stochastic approximation; communication delay; convergence;
D O I：
10.1007/BF02714713
中图分类号：
学科分类号：
摘要：
The pathwise convergence of a distributed, asynchronous stochastic approximation (SA) scheme is analyzed. The conditions imposed on the step size and noise are the weakest in comparison with the existing ones. The step sizes in different processors are allowed to be different, and the time-delays between processors are also allowed to be different and even time-varying.
引用
收藏
页码：249 / 258
页数：9
相关论文
共 22 条
[1]  
Robbins H.(1951)A stochastic approximation method Ann. Math. Stat. 22 400-407
[2]  
Monro S.(1994)Asynchronous stochastic approximation and q-learning Machine Learning 16 185-202
[3]  
Tsitsiklis J. N.(1986)Distributed asynchronous deterministic and stochastic gradient optimization algorithms IEEE Trans. Automat. Contr. 31 803-812
[4]  
Tsitsiklis J. N.(1998)Centralized and decentralized asynchronous optimization of stochastic discrete-event systems IEEE Trans. Automat. Contr. 43 631-655
[5]  
Bertsekas D. P.(1998)Asynchronous stochastic approximations SIAM J. Control Optim. 36 840-851
[6]  
Athans M.(1989)On w.p.1 convergence of a parallel stochastic approximation algorithm Probability in the Eng. and Infor. Sciences 3 55-75
[7]  
Vazquez-Abad F. J.(1994)Stochastic approximation in real time: A pipe line approach J. Computational Mathematics 12 21-30
[8]  
Cassandras C. G.(1990)Convergence speed and asymptotic distribution of a parallel Robbin-Monro method J. of Computational Mathematics 8 45-54
[9]  
Julka V.(1992)Acceleration of stochastic approximation by averaging SIAM J. on Control and Optimization 30 838-855
[10]  
Borkar V. S.(1986)Stochastic approximation procedures with randomly varying truncations Scientia Sinica, Ser. A 29 914-926
123