Convergence of simultaneous perturbation stochastic approximation for nondifferentiable optimization

被引:42
作者
He, Y [1 ]
Fu, MC
Marcus, SI
机构
[1] Colorado State Univ, Dept Elect & Comp Engn, Ft Collins, CO 80523 USA
[2] Univ Maryland, Syst Res Inst, College Pk, MD 20742 USA
基金
美国国家科学基金会;
关键词
convex analysis; simultaneous perturbation stochastic approximation (SPSA); subgradient;
D O I
10.1109/TAC.2003.815008
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this note, we consider simultaneous perturbation stochastic approximation for function minimization. The standard assumption for convergence is that the function be three times differentiable, although weaker assumptions have been used for special cases. However, all work that we are aware of at least requires differentiability. In this note, we relax the differentiability requirement and prove convergence using convex analysis.
引用
收藏
页码:1459 / 1463
页数:5
相关论文
共 19 条
[1]   A Kiefer-Wolfowitz algorithm with randomized differences [J].
Chen, HF ;
Duncan, TE ;
Pasik-Duncan, B .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 1999, 44 (03) :442-453
[2]   Noise conditions for prespecified convergence rates of stochastic approximation algorithms [J].
Chong, EKP ;
Wang, IJ ;
Kulkarni, SR .
IEEE TRANSACTIONS ON INFORMATION THEORY, 1999, 45 (02) :810-814
[3]   Weighted means in stochastic approximation of minima [J].
Dippon, J ;
Renz, J .
SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 1997, 35 (05) :1811-1827
[4]  
Fu MC, 1997, IIE TRANS, V29, P233
[5]  
Gerencsér L, 1998, IEEE DECIS CONTR P, P3907, DOI 10.1109/CDC.1998.761839
[6]   Convergence rate of moments in stochastic approximation with simultaneous perturbation gradient approximation and resetting [J].
Gerencsér, L .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 1999, 44 (05) :894-905
[7]  
HE Y, 2003, UNPUB MARKOV DECISIO
[8]   Simulation-based optimization with stochastic approximation using common random numbers [J].
Kleinman, NL ;
Spall, JC ;
Naiman, DQ .
MANAGEMENT SCIENCE, 1999, 45 (11) :1570-1578
[9]  
Kushner H. J., 1997, STOCHASTIC APPROXIMA
[10]  
Maryak JL, 2000, P AMER CONTR CONF, P3294, DOI 10.1109/ACC.2000.879174