Black-Box Search by Unbiased Variation

被引:132
作者
Lehre, Per Kristian [1 ]
Witt, Carsten [2 ]
机构
[1] Univ Nottingham, Sch Comp Sci, Nottingham NG8 1BB, England
[2] Tech Univ Denmark, Lyngby, Denmark
基金
英国工程与自然科学研究理事会;
关键词
Runtime analysis; Black-box complexity; GENERAL LOWER BOUNDS; EVOLUTIONARY ALGORITHMS; OPTIMIZATION; MUTATION;
D O I
10.1007/s00453-012-9616-8
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
The complexity theory for black-box algorithms, introduced by Droste, Jansen, and Wegener (Theory Comput. Syst. 39:525-544, 2006), describes common limits on the efficiency of a broad class of randomised search heuristics. There is an obvious trade-off between the generality of the black-box model and the strength of the bounds that can be proven in such a model. In particular, the original black-box model provides for well-known benchmark problems relatively small lower bounds, which seem unrealistic in certain cases and are typically not met by popular search heuristics. In this paper, we introduce a more restricted black-box model for optimisation of pseudo-Boolean functions which we claim captures the working principles of many randomised search heuristics including simulated annealing, evolutionary algorithms, randomised local search, and others. The key concept worked out is an unbiased variation operator. Considering this class of algorithms, significantly better lower bounds on the black-box complexity are proved, amongst them an Omega(nlogn) bound for functions with unique optimum. Moreover, a simple unimodal function and plateau functions are considered. We show that a simple (1+1) EA is able to match the runtime bounds in several cases.
引用
收藏
页码:623 / 642
页数:20
相关论文
共 50 条
  • [41] Black-Box Randomized Reductions in Algorithmic Mechanism Design
    Dughmi, Shaddin
    Roughgarden, Tim
    2010 IEEE 51ST ANNUAL SYMPOSIUM ON FOUNDATIONS OF COMPUTER SCIENCE, 2010, : 775 - 784
  • [42] BLACK-BOX RANDOMIZED REDUCTIONS IN ALGORITHMIC MECHANISM DESIGN
    Dughmi, Shaddin
    Roughgarden, Tim
    SIAM JOURNAL ON COMPUTING, 2014, 43 (01) : 312 - 336
  • [43] Black-Box Tuning for Language-Model-as-a-Service
    Sun, Tianxiang
    Shao, Yunfan
    Qian, Hong
    Huang, Xuanjing
    Qiu, Xipeng
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 162, 2022,
  • [44] Black-box calibration for complex-system simulation
    Forrester, Alexander I. J.
    PHILOSOPHICAL TRANSACTIONS OF THE ROYAL SOCIETY A-MATHEMATICAL PHYSICAL AND ENGINEERING SCIENCES, 2010, 368 (1924): : 3567 - 3579
  • [45] Black-Box Optimization Using Geodesics in Statistical Manifolds
    Bensadon, Jeremy
    ENTROPY, 2015, 17 (01): : 304 - 345
  • [46] PISA: Pixel skipping-based attentional black-box adversarial attack
    Wang, Jie
    Yin, Zhaoxia
    Jiang, Jing
    Tang, Jin
    Luo, Bin
    COMPUTERS & SECURITY, 2022, 123
  • [47] A Simple Proof for the Usefulness of Crossover in Black-Box Optimization
    Pinto, Eduardo Carvalho
    Doerr, Carola
    PARALLEL PROBLEM SOLVING FROM NATURE - PPSN XV, PT II, 2018, 11102 : 29 - 41
  • [48] Lessons From the Black-Box: Fast Crossover-Based Genetic Algorithms
    Doerr, Benjamin
    Doerr, Carola
    Ebel, Franziska
    GECCO'13: PROCEEDINGS OF THE 2013 GENETIC AND EVOLUTIONARY COMPUTATION CONFERENCE, 2013, : 781 - 788
  • [49] Center-Based Initialization for Large-Scale Black-Box Problems
    Rahnamayan, Shahryar
    Wang, G. Gary
    PROCEEDINGS OF THE 8TH WSEAS INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE, KNOWLEDGE ENGINEERING AND DATA BASES, 2009, : 531 - +
  • [50] Black-box Evolutionary Search for Adversarial Examples against Deep Image Classifiers in Non-Targeted Attacks
    Prochazka, Stepan
    Neruda, Roman
    2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2020,