Approximation of the distribution of convergence times for stochastic global optimisation

被引:0
作者
G. R. Wood
D. L. J. Alexander
D. W. Bulger
机构
[1] Massey University,Institute of Information Sciences and Technology
来源
Journal of Global Optimization | 2002年 / 22卷
关键词
Adaptive search; Markov chain; Optimization; Stochastic approximation; Stochastic process;
D O I
暂无
中图分类号
学科分类号
摘要
How long should we run a stochastic global optimisation algorithm such as simulated annealing? How should we tune such an algorithm? This paper proposes an approach to the study of these questions through successive approximation of a generic stochastic global optimisation algorithm with a sequence of stochastic processes, culminating in a backtracking adaptive search process. Our emerging understanding of backtracking adaptive search can thus be used to study the original algorithm. The first approximation, the averaged range process, has the same expected number of iterations to convergence as the original process.
引用
收藏
页码:271 / 284
页数:13
相关论文
共 50 条
[41]   Convergence Rates for Stochastic Approximation: Biased Noise with Unbounded Variance, and Applications [J].
Karandikar, Rajeeva Laxman ;
Vidyasagar, Mathukumalli .
JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2024, 203 (03) :2412-2450
[42]   Convergence rate of linear two-time-scale stochastic approximation [J].
Konda, VR ;
Tsitsiklis, JN .
ANNALS OF APPLIED PROBABILITY, 2004, 14 (02) :796-819
[43]   Stochastic Approximation and Newton's Estimate of a Mixing Distribution [J].
Martin, Ryan ;
Ghosh, Jayanta K. .
STATISTICAL SCIENCE, 2008, 23 (03) :365-382
[44]   Combining the stochastic counterpart and stochastic approximation methods [J].
Dussault, JP ;
Labrecque, D ;
LEcuyer, P ;
Rubinstein, RY .
DISCRETE EVENT DYNAMIC SYSTEMS-THEORY AND APPLICATIONS, 1997, 7 (01) :5-28
[45]   Stochastic approximation for background modelling [J].
Lopez-Rubio, Ezequiel ;
Marcos Luque-Baena, Rafael .
COMPUTER VISION AND IMAGE UNDERSTANDING, 2011, 115 (06) :735-749
[46]   A conjecture on global optimization using gradient-free stochastic approximation [J].
Maryak, JL ;
Chin, DC .
JOINT CONFERENCE ON THE SCIENCE AND TECHNOLOGY OF INTELLIGENT SYSTEMS, 1998, :441-445
[47]   Revisiting the ODE Method for Recursive Algorithms: Fast Convergence Using Quasi Stochastic Approximation [J].
Shuhang Chen ;
Adithya Devraj ;
Andrey Berstein ;
Sean Meyn .
Journal of Systems Science and Complexity, 2021, 34 :1681-1702
[48]   Convergence Rates of Finite Difference Stochastic Approximation Algorithms Part I: General Sampling [J].
Dai, Liyi .
SENSING AND ANALYSIS TECHNOLOGIES FOR BIOMEDICAL AND COGNITIVE APPLICATIONS 2016, 2016, 9871
[49]   Revisiting the ODE Method for Recursive Algorithms: Fast Convergence Using Quasi Stochastic Approximation [J].
Chen Shuhang ;
Devraj, Adithya ;
Berstein, Andrey ;
Meyn, Sean .
JOURNAL OF SYSTEMS SCIENCE & COMPLEXITY, 2021, 34 (05) :1681-1702
[50]   STOCHASTIC-APPROXIMATION WITH AVERAGING OF THE ITERATES - OPTIMAL ASYMPTOTIC RATE OF CONVERGENCE FOR GENERAL PROCESSES [J].
KUSHNER, HJ ;
YANG, JC .
SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 1993, 31 (04) :1045-1062