Escaping Local Optima Using Crossover With Emergent Diversity

被引:108
作者
Dang, Duc-Cuong [1 ]
Friedrich, Tobias [2 ]
Koetzing, Timo [2 ]
Krejca, Martin S. [2 ]
Lehre, Per Kristian [3 ]
Oliveto, Pietro S. [4 ]
Sudholt, Dirk [4 ]
Sutton, Andrew M. [2 ]
机构
[1] Univ Nottingham, Sch Comp Sci, ASAP Res Grp, Nottingham NG8 1BB, England
[2] Hasso Plattner Inst, Chair Algorithm Engn, D-14482 Potsdam, Germany
[3] Univ Birmingham, Sch Comp Sci, Birmingham B15 2TT, W Midlands, England
[4] Univ Sheffield, Dept Comp Sci, Sheffield S1 4DP, S Yorkshire, England
基金
英国工程与自然科学研究理事会;
关键词
Diversity; genetic algorithms (GAs); recombination; runtime analysis; theory; SIMPLE GENETIC ALGORITHM; EVOLUTIONARY ALGORITHMS; RUNTIME ANALYSIS; OPTIMIZATION; MECHANISMS; COMPLEXITY;
D O I
10.1109/TEVC.2017.2724201
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Population diversity is essential for avoiding premature convergence in genetic algorithms (GAs) and for the effective use of crossover. Yet the dynamics of how diversity emerges in populations are not well understood. We use rigorous runtime analysis to gain insight into population dynamics and GA performance for the (mu + 1) GA and the Jump test function. We show that the interplay of crossover followed by mutation may serve as a catalyst leading to a sudden burst of diversity. This leads to significant improvements of the expected optimization time compared to mutation-only algorithms like the (1 + 1) evolutionary algorithm. Moreover, increasing the mutation rate by an arbitrarily small constant factor can facilitate the generation of diversity, leading to even larger speedups. Experiments were conducted to complement our theoretical findings and further highlight the benefits of crossover on the function class.
引用
收藏
页码:484 / 497
页数:14
相关论文
共 35 条
  • [1] [Anonymous], 1968, An introduction to probability theory and its applications
  • [2] [Anonymous], 1991, Handbook of Genetic Algorithms
  • [3] Auger A., 2011, Theory of randomized search heuristics: Foundations and recent developments
  • [4] Barton N, 2013, GECCO'13: PROCEEDINGS OF THE 2013 GENETIC AND EVOLUTIONARY COMPUTATION CONFERENCE, P1573
  • [5] Effects of diversity control in single-objective and multi-objective genetic algorithms
    Chaiyaratana, Nachol
    Piroonratana, Theera
    Sangkawelert, Nuntapon
    [J]. JOURNAL OF HEURISTICS, 2007, 13 (01) : 1 - 34
  • [6] Corus D, 2014, LECT NOTES COMPUT SC, V8672, P912
  • [7] Exploration and Exploitation in Evolutionary Algorithms: A Survey
    Crepinsek, Matej
    Liu, Shih-Hsi
    Mernik, Marjan
    [J]. ACM COMPUTING SURVEYS, 2013, 45 (03)
  • [8] From black-box complexity to designing new genetic algorithms
    Doerr, Benjamin
    Doerr, Carola
    Ebel, Franziska
    [J]. THEORETICAL COMPUTER SCIENCE, 2015, 567 : 87 - 104
  • [9] Crossover can provably be useful in evolutionary computation
    Doerr, Benjamin
    Happ, Edda
    Klein, Christian
    [J]. THEORETICAL COMPUTER SCIENCE, 2012, 425 : 17 - 33
  • [10] On the analysis of the (1+1) evolutionary algorithm
    Droste, S
    Jansen, T
    Wegener, I
    [J]. THEORETICAL COMPUTER SCIENCE, 2002, 276 (1-2) : 51 - 81