ACCELERATION OF STOCHASTIC-APPROXIMATION BY AVERAGING

被引：1033
作者：
POLYAK, BT [1 ]
JUDITSKY, AB [1 ]
机构：
[1] INST RECH INFORMAT & SYST ALEATOIRES,F-35042 RENNES,FRANCE
来源：
SIAM JOURNAL ON CONTROL AND OPTIMIZATION | 1992年 / 30卷 / 04期
关键词：
STOCHASTIC APPROXIMATION; RECURSIVE ESTIMATION; STOCHASTIC OPTIMIZATION; OPTIMAL ALGORITHMS;
D O I：
10.1137/0330046
中图分类号：
TP [自动化技术、计算机技术];
学科分类号：
0812 ;
摘要：
A new recursive algorithm of stochastic approximation type with the averaging of trajectories is investigated. Convergence with probability one is proved for a variety of classical optimization and identification problems. It is also demonstrated for these problems that the proposed algorithm achieves the highest possible rate of convergence.
引用
收藏
页码：838 / 855
页数：18
相关论文
共 50 条
  • [31] Stochastic approximation for global random optimization
    Maryak, JL
    Chin, DC
    PROCEEDINGS OF THE 2000 AMERICAN CONTROL CONFERENCE, VOLS 1-6, 2000, : 3294 - 3298
  • [32] A new hybrid stochastic approximation algorithm
    Zi Xu
    Xinming Wu
    Optimization Letters, 2013, 7 : 593 - 606
  • [33] Asymptotically optimal dynamic stochastic approximation
    Uosaki, K
    Hatanaka, T
    (SYSID'97): SYSTEM IDENTIFICATION, VOLS 1-3, 1998, : 269 - 274
  • [34] Stochastic Approximation Algorithms for Trailing Stop
    Yin, G.
    Zhang, Q.
    Zhuang, C.
    47TH IEEE CONFERENCE ON DECISION AND CONTROL, 2008 (CDC 2008), 2008, : 5590 - 5595
  • [35] A new hybrid stochastic approximation algorithm
    Xu, Zi
    Wu, Xinming
    OPTIMIZATION LETTERS, 2013, 7 (03) : 593 - 606
  • [36] Stochastic Averaging for Constrained Optimization With Application to Online Resource Allocation
    Chen, Tianyi
    Mokhtari, Aryan
    Wang, Xin
    Ribeiro, Alejandro
    Giannakis, Georgios B.
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2017, 65 (12) : 3078 - 3093
  • [37] Regularized Iterative Stochastic Approximation Methods for Stochastic Variational Inequality Problems
    Koshal, Jayash
    Nedic, Angelia
    Shanbhag, Uday V.
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2013, 58 (03) : 594 - 609
  • [38] Truncated stochastic approximation with moving bounds: convergence
    Sharia T.
    Statistical Inference for Stochastic Processes, 2014, 17 (2) : 163 - 179
  • [39] ADAPTIVE STOCHASTIC APPROXIMATION FOR MEASUREMENT WITH CORRELATED NOISE
    GAO Aijun (Institute of Mathematical Sciences
    Systems Science and Mathematical Sciences, 1992, (03) : 213 - 226
  • [40] Stochastic approximation algorithms: Overview and recent trends
    Bharath, B
    Borkar, VS
    SADHANA-ACADEMY PROCEEDINGS IN ENGINEERING SCIENCES, 1999, 24 (4-5): : 425 - 452
12345