Asymptotic behavior of asynchronous stochastic approximation

被引:0
|
作者
方海涛
陈翰馥
机构
基金
中国国家自然科学基金;
关键词
asynchronous stochastic approximation; communication delay; convergence;
D O I
暂无
中图分类号
O211.5 [随机变量];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
The pathwise convergence of a distributed, asynchronous stochastic approximation (SA) scheme is analyzed. The conditions imposed on the step size and noise are the weakest in comparison with the existing ones. The step sizes in different processors are allowed to be different, and the time-delays between processors are also allowed to be different and even time-varying.
引用
收藏
页码:249 / 258
页数:10
相关论文
共 50 条
  • [31] Asynchronous Approximation of a Single Component of the Solution to a Linear System
    Ozdaglar, Asuman
    Shah, Devavrat
    Yu, Christina Lee
    IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2020, 7 (03): : 975 - 986
  • [32] Stochastic Successive Convex Approximation for General Stochastic Optimization Problems
    Ye, Chencheng
    Cui, Ying
    IEEE WIRELESS COMMUNICATIONS LETTERS, 2020, 9 (06) : 755 - 759
  • [33] Decentralized Asynchronous Nonconvex Stochastic Optimization on Directed Graphs
    Kungurtsev, Vyacheslav
    Morafah, Mahdi
    Javidi, Tara
    Scutari, Gesualdo
    IEEE TRANSACTIONS ON CONTROL OF NETWORK SYSTEMS, 2023, 10 (04): : 1796 - 1804
  • [34] A new regularized stochastic approximation framework for stochastic inverse problems
    Dippon, Juergen
    Gwinner, Joachim
    Khan, Akhtar A.
    Sama, Miguel
    NONLINEAR ANALYSIS-REAL WORLD APPLICATIONS, 2023, 73
  • [35] Markovian stochastic approximation with expanding projections
    Andrieu, Christophe
    Vihola, Matti
    BERNOULLI, 2014, 20 (02) : 545 - 585
  • [36] DISTRIBUTED STOCHASTIC APPROXIMATION WITH LOCAL PROJECTIONS
    Shah, Suhail Mohmad
    Borkar, Vivek S.
    SIAM JOURNAL ON OPTIMIZATION, 2018, 28 (04) : 3375 - 3401
  • [37] A Stopping Rule for Linear Stochastic Approximation
    Wada, Takayuki
    Itani, Takamitsu
    Fujisaki, Yasumasa
    49TH IEEE CONFERENCE ON DECISION AND CONTROL (CDC), 2010, : 4171 - 4176
  • [38] Random directions methods in stochastic approximation
    Kushner, HJ
    Yin, G
    PROCEEDINGS OF THE 36TH IEEE CONFERENCE ON DECISION AND CONTROL, VOLS 1-5, 1997, : 3430 - 3435
  • [39] An approximation scheme of stochastic Stokes equations
    Yang, Juan
    Liu, Hanbing
    ELECTRONIC COMMUNICATIONS IN PROBABILITY, 2013, 18 : 1 - 10
  • [40] Convergence analysis of dynamic stochastic approximation
    Chen, HF
    Uosaki, K
    SYSTEMS & CONTROL LETTERS, 1998, 35 (05) : 309 - 315