PROS-C: Accelerating Random Orthogonal Search for Global Optimization Using Crossover

被引:0
作者
Tong, Bruce Kwong-Bun [1 ,2 ]
Lau, Wing Cheong [2 ]
Sung, Chi Wan [3 ]
Wong, Wing Shing [2 ]
机构
[1] Hong Kong Metropolitan Univ, Dept Elect Engn & Comp Sci, Hong Kong, Peoples R China
[2] Chinese Univ Hong Kong, Dept Informat Engn, Hong Kong, Peoples R China
[3] City Univ Hong Kong, Dept Elect Engn, Hong Kong, Peoples R China
来源
MACHINE LEARNING, OPTIMIZATION, AND DATA SCIENCE, LOD 2023, PT II | 2024年 / 14506卷
关键词
Global Optimization; Pure Random Orthogonal Search; Genetic Algorithm; Blend Crossover;
D O I
10.1007/978-3-031-53966-4_21
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Pure Random Orthogonal Search (PROS) is a parameterless evolutionary algorithm (EA) that has shown superior performance when compared to many existing EAs on well-known benchmark functions with limited search budgets. Its implementation simplicity, computational efficiency, and lack of hyperparameters make it attractive to both researchers and practitioners. However, PROS can be inefficient when the error requirement becomes stringent. In this paper, we propose an extension to PROS, called Pure Random Orthogonal Search with Crossover (PROS-C), which aims to improve the convergence rate of PROS while maintaining its simplicity. We analyze the performance of PROS-C on a class of functions that are monotonically increasing in each single dimension. Our numerical experiments demonstrate that, with the addition of a simple crossover operation, PROS-C consistently and significantly reduces the errors of the obtained solutions on a wide range of benchmark functions. Moreover, PROS-C converges faster than Genetic Algorithms (GA) on benchmark functions when the search budget is tight. The results suggest that PROS-C is a promising algorithm for optimization problems that require high computational efficiency and with a limited search budget.
引用
收藏
页码:283 / 298
页数:16
相关论文
共 12 条
  • [1] A numerical evaluation of several stochastic algorithms on selected continuous global optimization test problems
    Ali, MM
    Khompatraporn, C
    Zabinsky, ZB
    [J]. JOURNAL OF GLOBAL OPTIMIZATION, 2005, 31 (04) : 635 - 672
  • [2] Pymoo: Multi-Objective Optimization in Python']Python
    Blank, Julian
    Deb, Kalyanmoy
    [J]. IEEE ACCESS, 2020, 8 : 89497 - 89509
  • [3] ESHELMAN LJ, 1993, FOUNDATIONS OF GENETIC ALGORITHMS 2, P187
  • [4] Holland J. H., 1992, Adaptation in Natural and Artificial Systems: An Introductory Analysis With Applications to Biology, Control, and Artificial Intelligence
  • [5] Kennedy J, 1995, 1995 IEEE INTERNATIONAL CONFERENCE ON NEURAL NETWORKS PROCEEDINGS, VOLS 1-6, P1942, DOI 10.1109/icnn.1995.488968
  • [6] Pure Random Orthogonal Search (PROS): A Plain and Elegant Parameterless Algorithm for Global Optimization
    Plevris, Vagelis
    Bakas, Nikolaos P.
    Solorzano, German
    [J]. APPLIED SCIENCES-BASEL, 2021, 11 (11):
  • [7] Differential evolution - A simple and efficient heuristic for global optimization over continuous spaces
    Storn, R
    Price, K
    [J]. JOURNAL OF GLOBAL OPTIMIZATION, 1997, 11 (04) : 341 - 359
  • [8] Tong B.K.B., Analysis of pros-c on monotonically increasing functions
  • [9] Random Orthogonal Search with Triangular and Quadratic Distributions (TROS and QROS): Parameterless Algorithms for Global Optimization
    Tong, Bruce Kwong-Bun
    Sung, Chi Wan
    Wong, Wing Shing
    [J]. APPLIED SCIENCES-BASEL, 2023, 13 (03):
  • [10] Cuckoo Search via Levey Flights
    Yang, Xin-She
    Deb, Suash
    [J]. 2009 WORLD CONGRESS ON NATURE & BIOLOGICALLY INSPIRED COMPUTING (NABIC 2009), 2009, : 210 - +