ACCELERATION OF STOCHASTIC-APPROXIMATION BY AVERAGING

被引：1035
作者：
POLYAK, BT [1 ]
JUDITSKY, AB [1 ]
机构：
[1] INST RECH INFORMAT & SYST ALEATOIRES,F-35042 RENNES,FRANCE
来源：
SIAM JOURNAL ON CONTROL AND OPTIMIZATION | 1992年 / 30卷 / 04期
关键词：
STOCHASTIC APPROXIMATION; RECURSIVE ESTIMATION; STOCHASTIC OPTIMIZATION; OPTIMAL ALGORITHMS;
D O I：
10.1137/0330046
中图分类号：
TP [自动化技术、计算机技术];
学科分类号：
0812 ;
摘要：
A new recursive algorithm of stochastic approximation type with the averaging of trajectories is investigated. Convergence with probability one is proved for a variety of classical optimization and identification problems. It is also demonstrated for these problems that the proposed algorithm achieves the highest possible rate of convergence.
引用
收藏
页码：838 / 855
页数：18
相关论文
共 50 条
  • [21] Some guidelines for using iterate averaging in stochastic approximation
    Maryak, JL
    PROCEEDINGS OF THE 36TH IEEE CONFERENCE ON DECISION AND CONTROL, VOLS 1-5, 1997, : 2287 - 2290
  • [22] Asymptotic Expansions for the Stochastic Approximation Averaging Procedure in Continuous Time
    S. M. Pergamenshchikov
    Statistical Inference for Stochastic Processes, 1998, 1 (2) : 197 - 223
  • [23] STRONG CONSISTENCY OF PARAMETER ESTIMATES IN DIRECT SELF-TUNING CONTROL ALGORITHMS BASED ON STOCHASTIC-APPROXIMATION
    RADENKOVIC, MS
    STANKOVIC, SS
    AUTOMATICA, 1990, 26 (03) : 533 - 544
  • [24] Blind adaptive multiuser detection for cellular systems using stochastic approximation with averaging
    Das, D
    Varanasi, MK
    IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2002, 20 (02) : 310 - 319
  • [25] Convergence rate and averaging of nonlinear two-time-scale stochastic approximation algorithms
    Mokkadem, Abdelkader
    Pelletier, Mariane
    ANNALS OF APPLIED PROBABILITY, 2006, 16 (03) : 1671 - 1702
  • [26] ACCELERATED STOCHASTIC APPROXIMATION
    Delyon, Bernard
    Juditsky, Anatoli
    SIAM JOURNAL ON OPTIMIZATION, 1993, 3 (04) : 868 - 881
  • [27] Finite-sample analysis of iterate averaging method for stochastic approximation with quadratic loss function
    Yang, Kaining
    Wang, Kunbo
    Feng, Chen
    2017 51ST ANNUAL CONFERENCE ON INFORMATION SCIENCES AND SYSTEMS (CISS), 2017,
  • [28] Adaptive stochastic approximation algorithm
    Kresoja, Milena
    Luzanin, Zorana
    Stojkovska, Irena
    NUMERICAL ALGORITHMS, 2017, 76 (04) : 917 - 937
  • [29] Adaptive stochastic approximation algorithm
    Milena Kresoja
    Zorana Lužanin
    Irena Stojkovska
    Numerical Algorithms, 2017, 76 : 917 - 937
  • [30] Stochastic Approximation
    Borkar, Vivek S.
    RESONANCE-JOURNAL OF SCIENCE EDUCATION, 2013, 18 (12): : 1086 - 1094
12345