Black-Box Search by Unbiased Variation

被引:132
作者
Lehre, Per Kristian [1 ]
Witt, Carsten [2 ]
机构
[1] Univ Nottingham, Sch Comp Sci, Nottingham NG8 1BB, England
[2] Tech Univ Denmark, Lyngby, Denmark
基金
英国工程与自然科学研究理事会;
关键词
Runtime analysis; Black-box complexity; GENERAL LOWER BOUNDS; EVOLUTIONARY ALGORITHMS; OPTIMIZATION; MUTATION;
D O I
10.1007/s00453-012-9616-8
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
The complexity theory for black-box algorithms, introduced by Droste, Jansen, and Wegener (Theory Comput. Syst. 39:525-544, 2006), describes common limits on the efficiency of a broad class of randomised search heuristics. There is an obvious trade-off between the generality of the black-box model and the strength of the bounds that can be proven in such a model. In particular, the original black-box model provides for well-known benchmark problems relatively small lower bounds, which seem unrealistic in certain cases and are typically not met by popular search heuristics. In this paper, we introduce a more restricted black-box model for optimisation of pseudo-Boolean functions which we claim captures the working principles of many randomised search heuristics including simulated annealing, evolutionary algorithms, randomised local search, and others. The key concept worked out is an unbiased variation operator. Considering this class of algorithms, significantly better lower bounds on the black-box complexity are proved, amongst them an Omega(nlogn) bound for functions with unique optimum. Moreover, a simple unimodal function and plateau functions are considered. We show that a simple (1+1) EA is able to match the runtime bounds in several cases.
引用
收藏
页码:623 / 642
页数:20
相关论文
共 50 条
  • [31] AutoTinyML for microcontrollers: Dealing with black-box deployability
    Perego, Riccardo
    Candelieri, Antonio
    Archetti, Francesco
    Pau, Danilo
    EXPERT SYSTEMS WITH APPLICATIONS, 2022, 207
  • [32] Toward Visual Distortion in Black-Box Attacks
    Li, Nannan
    Chen, Zhenzhong
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 6156 - 6167
  • [33] Ranking-Based Black-Box Complexity
    Doerr, Benjamin
    Winzen, Carola
    ALGORITHMICA, 2014, 68 (03) : 571 - 609
  • [34] Ranking-Based Black-Box Complexity
    Benjamin Doerr
    Carola Winzen
    Algorithmica, 2014, 68 : 571 - 609
  • [35] A Novel Hybrid Direct Search Method for Constrained Non-Smooth Black-Box Problems
    Martelli, Emanuele
    Amaldi, Edoardo
    23 EUROPEAN SYMPOSIUM ON COMPUTER AIDED PROCESS ENGINEERING, 2013, 32 : 295 - 300
  • [36] Black-Box Prompt Tuning With Subspace Learning
    Zheng, Yuanhang
    Tan, Zhixing
    Li, Peng
    Liu, Yang
    IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2024, 32 : 3002 - 3013
  • [37] A Black-Box Method for Parametric Model Order Reduction
    Geuss, M.
    Lohmann, B.
    Pelterstorfer, B.
    Willcox, K.
    IFAC PAPERSONLINE, 2015, 48 (01): : 168 - +
  • [38] Physical Black-Box Adversarial Attacks Through Transformations
    Jiang, Wenbo
    Li, Hongwei
    Xu, Guowen
    Zhang, Tianwei
    Lu, Rongxing
    IEEE TRANSACTIONS ON BIG DATA, 2023, 9 (03) : 964 - 974
  • [39] Bayesian Performance Analysis for Black-Box Optimization Benchmarking
    Calvo, Borja
    Shir, Ofer M.
    Ceberio, Josu
    Doerr, Carola
    Wang, Hao
    Back, Thomas
    Lozano, Jose A.
    PROCEEDINGS OF THE 2019 GENETIC AND EVOLUTIONARY COMPUTATION CONFERENCE COMPANION (GECCCO'19 COMPANION), 2019, : 1789 - 1797
  • [40] Black-Box Acceleration of Monotone Convex Program Solvers
    London, Palma
    Vardi, Shai
    Eghbali, Reza
    Wierman, Adam
    OPERATIONS RESEARCH, 2024, 72 (02) : 796 - 815