Analysis of runtime of optimization algorithms for noisy functions over discrete codomains

被引:25
作者
Akimoto, Youhei [1 ]
Astete-Morales, Sandra [2 ]
Teytaud, Olivier [2 ]
机构
[1] Shinshu Univ, Inst Engn, Nagano, Japan
[2] Univ Paris Sud, TAO INRIA LRI, F-91405 Orsay, France
关键词
Discrete optimization; Additive noise; Runtime analysis; LOWER BOUNDS; MODEL;
D O I
10.1016/j.tcs.2015.04.008
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
We consider in this work the application of optimization algorithms to problems over discrete codomains corrupted by additive unbiased noise. We propose a modification of the algorithms by repeating the fitness evaluation of the noisy function sufficiently so that, with a fix probability, the function evaluation on the noisy case is identical to the true value. If the runtime of the algorithms on the noise-free case is known, the number of resampling is chosen accordingly. If not, the number of resampling is chosen regarding to the number of fitness evaluations, in an anytime manner. We conclude that if the additive noise is Gaussian, then the runtime on the noisy case, for an adapted algorithm using resamplings, is similar to the runtime on the noise-free case: we incur only an extra logarithmic factor. If the noise is non-Gaussian but with finite variance, then the total runtime of the noisy case is quadratic in function of the runtime on the noise-free case. (C) 2015 Elsevier B.V. All rights reserved.
引用
收藏
页码:42 / 50
页数:9
相关论文
共 25 条
  • [1] A general noise model and its effects on evolution strategy performance
    Arnold, Dirk V.
    Beyer, Hans-Georg
    [J]. IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION, 2006, 10 (04) : 380 - 391
  • [2] Log-log Convergence for Noisy Optimization
    Astete-Morales, S.
    Liu, J.
    Teytaud, Olivier
    [J]. ARTIFICIAL EVOLUTION, EA 2013, 2014, 8752 : 16 - 28
  • [3] Booker AJ, 1998, PROG SYST C, V24, P49
  • [4] An algorithm for the use of surrogate models in modular flowsheet optimization
    Caballero, Jose A.
    Grossmann, Ignacio E.
    [J]. AICHE JOURNAL, 2008, 54 (10) : 2633 - 2650
  • [5] Coulom Remi, 2012, Advances in Computer Games. 13th International Conference, ACG 2011. Revised Selected Papers, P146, DOI 10.1007/978-3-642-31866-5_13
  • [6] DEJONG KA, 1992, PARALLEL PROBLEM SOLVING FROM NATURE, 2, P3
  • [7] Droste S, 2004, LECT NOTES COMPUT SC, V3102, P1088
  • [8] On the analysis of the (1+1) evolutionary algorithm
    Droste, S
    Jansen, T
    Wegener, I
    [J]. THEORETICAL COMPUTER SCIENCE, 2002, 276 (1-2) : 51 - 81
  • [9] Upper and lower bounds for randomized search heuristics in black-box optimization
    Droste, Stefan
    Jansen, Thomas
    Wegener, Ingo
    [J]. THEORY OF COMPUTING SYSTEMS, 2006, 39 (04) : 525 - 544
  • [10] Ermolova Natalia, 2004, 2004 12th European Signal Processing Conference (EUSIPCO), P1087