Black-Box Search by Unbiased Variation

被引:138
作者
Lehre, Per Kristian [1 ]
Witt, Carsten [2 ]
机构
[1] Univ Nottingham, Sch Comp Sci, Nottingham NG8 1BB, England
[2] Tech Univ Denmark, Lyngby, Denmark
基金
英国工程与自然科学研究理事会;
关键词
Runtime analysis; Black-box complexity; GENERAL LOWER BOUNDS; EVOLUTIONARY ALGORITHMS; OPTIMIZATION; MUTATION;
D O I
10.1007/s00453-012-9616-8
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
The complexity theory for black-box algorithms, introduced by Droste, Jansen, and Wegener (Theory Comput. Syst. 39:525-544, 2006), describes common limits on the efficiency of a broad class of randomised search heuristics. There is an obvious trade-off between the generality of the black-box model and the strength of the bounds that can be proven in such a model. In particular, the original black-box model provides for well-known benchmark problems relatively small lower bounds, which seem unrealistic in certain cases and are typically not met by popular search heuristics. In this paper, we introduce a more restricted black-box model for optimisation of pseudo-Boolean functions which we claim captures the working principles of many randomised search heuristics including simulated annealing, evolutionary algorithms, randomised local search, and others. The key concept worked out is an unbiased variation operator. Considering this class of algorithms, significantly better lower bounds on the black-box complexity are proved, amongst them an Omega(nlogn) bound for functions with unique optimum. Moreover, a simple unimodal function and plateau functions are considered. We show that a simple (1+1) EA is able to match the runtime bounds in several cases.
引用
收藏
页码:623 / 642
页数:20
相关论文
共 35 条
[1]  
Anil G, 2009, FOGA'09: PROCEEDINGS OF THE 10TH ACM SIGRVO CONFERENCE ON FOUNDATIONS OF GENETIC ALGORITHMS, P67
[2]  
[Anonymous], 2001, SWARM INTELL-US
[3]  
[Anonymous], 2004, ANT COLONY OPTIMIZAT
[4]  
Böttcher S, 2010, LECT NOTES COMPUT SC, V6238, P1, DOI 10.1007/978-3-642-15844-5_1
[5]  
Cathabard S, 2011, FOGA 11: PROCEEDINGS OF THE 2011 ACM/SIGEVO FOUNDATIONS OF GENETIC ALGORITHMS XI, P173
[6]   TAIL OF THE HYPERGEOMETRIC DISTRIBUTION [J].
CHVATAL, V .
DISCRETE MATHEMATICS, 1979, 25 (03) :285-287
[7]  
Doerr B., 2010, P GECCO 10, P1457
[8]   On the analysis of the (1+1) evolutionary algorithm [J].
Droste, S ;
Jansen, T ;
Wegener, I .
THEORETICAL COMPUTER SCIENCE, 2002, 276 (1-2) :51-81
[9]  
Droste S, 2000, LECT NOTES COMPUT SC, V1802, P29
[10]   Upper and lower bounds for randomized search heuristics in black-box optimization [J].
Droste, Stefan ;
Jansen, Thomas ;
Wegener, Ingo .
THEORY OF COMPUTING SYSTEMS, 2006, 39 (04) :525-544