Asymptotic behavior of asynchronous stochastic approximation

被引：0
|
作者：
方海涛
陈翰馥
机构：
来源：
ScienceinChina(SeriesF:InformationSciences) | 2001年 / 04期
基金：
中国国家自然科学基金;
关键词：
asynchronous stochastic approximation; communication delay; convergence;
D O I：
暂无
中图分类号：
O211.5 [随机变量];
学科分类号：
020208 ; 070103 ; 0714 ;
摘要：
The pathwise convergence of a distributed, asynchronous stochastic approximation (SA) scheme is analyzed. The conditions imposed on the step size and noise are the weakest in comparison with the existing ones. The step sizes in different processors are allowed to be different, and the time-delays between processors are also allowed to be different and even time-varying.
引用
收藏
页码：249 / 258
页数：10
相关论文
共 50 条
  • [21] An Asynchronous Parallel Stochastic Coordinate Descent Algorithm
    Liu, Ji
    Wright, Stephen J.
    Re, Christopher
    Bittorf, Victor
    Sridhar, Srikrishna
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 32 (CYCLE 2), 2014, 32 : 469 - 477
  • [22] Asynchronous Doubly Stochastic Sparse Kernel Learning
    Gu, Bin
    Miao, Xin
    Huo, Zhouyuan
    Huang, Heng
    THIRTY-SECOND AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTIETH INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / EIGHTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2018, : 3085 - 3092
  • [23] Stochastic approximation in infinite dimensions
    Karandikar, Rajeeva L.
    Rao, B. V.
    INFINITE DIMENSIONAL ANALYSIS QUANTUM PROBABILITY AND RELATED TOPICS, 2024, 27 (04)
  • [24] Statistical Approximation for Stochastic Processes
    Anastassiou, George A.
    Duman, Oktay
    Erkus-Duman, Esra
    STOCHASTIC ANALYSIS AND APPLICATIONS, 2009, 27 (03) : 460 - 474
  • [25] PENALTY METHODS WITH STOCHASTIC APPROXIMATION FOR STOCHASTIC NONLINEAR PROGRAMMING
    Wang, Xiao
    Ma, Shiqian
    Yuan, Ya-Xiang
    MATHEMATICS OF COMPUTATION, 2017, 86 (306) : 1793 - 1820
  • [26] Weighted averaging and stochastic approximation
    Wang, IJ
    Chong, EKP
    Kulkarni, SR
    MATHEMATICS OF CONTROL SIGNALS AND SYSTEMS, 1997, 10 (01) : 41 - 60
  • [27] Stochastic Approximation on Riemannian Manifolds
    Shah, Suhail M.
    APPLIED MATHEMATICS AND OPTIMIZATION, 2021, 83 (02) : 1123 - 1151
  • [28] THE APPROXIMATION OF SEPARABLE STOCHASTIC PROGRAMS
    FRAUENDORFER, K
    JOURNAL OF COMPUTATIONAL AND APPLIED MATHEMATICS, 1994, 56 (1-2) : 23 - 44
  • [29] An Asynchronous Parallel Stochastic Coordinate Descent Algorithm
    Liu, Ji
    Wright, Stephen J.
    Re, Christopher
    Bittorf, Victor
    Sridhar, Srikrishna
    JOURNAL OF MACHINE LEARNING RESEARCH, 2015, 16 : 285 - 322
  • [30] Asymptotic Bias of Stochastic Gradient Search
    Tadic, Vladislav B.
    Doucet, A.
    2011 50TH IEEE CONFERENCE ON DECISION AND CONTROL AND EUROPEAN CONTROL CONFERENCE (CDC-ECC), 2011, : 722 - 727
12345