Preliminary Analysis of Simple Novelty Search

被引:1
作者
Wiegand, R. Paul [1 ]
机构
[1] Winthrop Univ, Dept Comp Sci & Quantitat Methods, Rock Hill, SC 29733 USA
关键词
Novelty search; quality diversity; convergence; k nearest neighbors;
D O I
10.1162/evco_a_00340
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Novelty search is a powerful tool for finding diverse sets of objects in complicated spaces. Recent experiments on simplified versions of novelty search introduce the idea that novelty search happens at the level of the archive space, rather than individual points. The sparseness measure and archive update criterion create a process that is driven by a two measures: (1) spread out to cover the space while trying to remain as efficiently packed as possible, and (2) metrics inspired by k nearest neighbor theory.In this paper, we generalize previous simplifications of novelty search to include traditional population (mu,lambda) dynamics for generating new search points, where the population and the archive are updated separately. We provide some theoretical guidance regarding balancing mutation and sparseness criteria and introduce the concept of saturation as a way of talking about fully covered spaces. We show empirically that claims that novelty search is inherently objectiveless are incorrect. We leverage the understanding of novelty search as an optimizer of archive coverage, suggest several ways to improve the search, and demonstrate one simple improvement-generating some new points directly from the archive rather than the parent population.
引用
收藏
页码:249 / 273
页数:25
相关论文
共 38 条
[1]  
[Anonymous], 2002, Foundations of Genetic Programming, DOI [10.1007/978-3-662-04726-2, DOI 10.1007/978-3-662-04726-2]
[2]  
Boyan JA, 1998, FIFTEENTH NATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE (AAAI-98) AND TENTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICAL INTELLIGENCE (IAAI-98) - PROCEEDINGS, P3
[3]  
Bryant V., 1985, Metric Spaces: Iteration and Application, DOI [DOI 10.1017/9781139171854, 10.1017/9781139171854]
[4]   Self-Referential Quality Diversity Through Differential Map-Elites [J].
Choi, Tae Jong ;
Togelius, Julian .
PROCEEDINGS OF THE 2021 GENETIC AND EVOLUTIONARY COMPUTATION CONFERENCE (GECCO'21), 2021, :502-509
[5]   Nearest neighbor queries in metric spaces [J].
Clarkson, KL .
DISCRETE & COMPUTATIONAL GEOMETRY, 1999, 22 (01) :63-93
[6]  
Coninx Alexandre, 2021, GECCO '21: Proceedings of the Genetic and Evolutionary Computation Conference Companion, P87, DOI 10.1145/3449726.3459493
[7]   Quality and Diversity Optimization: A Unifying Modular Framework [J].
Cully, Antoine ;
Demiris, Yiannis .
IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION, 2018, 22 (02) :245-259
[8]  
De Jong K. A., 2006, EVOLUTIONARY COMPUTA
[9]   Novelty Search makes Evolvability Inevitable [J].
Doncieux, Stephane ;
Paolo, Giuseppe ;
Laflaquiere, Alban ;
Coninx, Alexandre .
GECCO'20: PROCEEDINGS OF THE 2020 GENETIC AND EVOLUTIONARY COMPUTATION CONFERENCE, 2020, :85-93
[10]   Novelty Search: a Theoretical Perspective [J].
Doncieux, Stephane ;
Laflaquiere, Alban ;
Coninx, Alexandre .
PROCEEDINGS OF THE 2019 GENETIC AND EVOLUTIONARY COMPUTATION CONFERENCE (GECCO'19), 2019, :99-106