Accelerated derivative-free spectral residual method for nonlinear systems of equations

被引:0
作者
Birgin, Ernesto G. [1 ]
Gardenghi, John L. [2 ]
Marcondes, Diaulas S. [3 ]
Martinez, Jose Mario [4 ]
机构
[1] Univ Sao Paulo, Inst Math & Stat, Dept Comp Sci, Sao Paulo, SP, Brazil
[2] Univ Brasilia, Fac Sci & Technol Engn, Brasilia, DF, Brazil
[3] Univ Sao Paulo, Inst Math & Stat, Dept Appl Math, Sao Paulo, SP, Brazil
[4] Univ Estadual Campinas, Inst Math, Dept Appl Math, Stat & Sci Comp, Campinas, SP, Brazil
基金
巴西圣保罗研究基金会;
关键词
Spectral residual methods; nonlinear systems of equations; derivative-free; acceleration; algorithms; ALGORITHM; BARZILAI; SOFTWARE;
D O I
10.1051/ro/2024234
中图分类号
C93 [管理学]; O22 [运筹学];
学科分类号
070105 ; 12 ; 1201 ; 1202 ; 120202 ;
摘要
Many continuous models of natural phenomena require the solution of large-scale nonlinear systems of equations. For example, the discretization of many partial differential equations, which are widely used in physics, chemistry, and engineering, requires the solution of subproblems in which a nonlinear algebraic system has to be addressed, especially one in which stable implicit difference schemes are used. Spectral residual methods are powerful tools for solving nonlinear systems of equations without derivatives. In a recent paper [Birgin and Mart & iacute;nez, SIAM J. Numer. Anal. 60 (2022) 3145-3180], it was shown that an acceleration technique based on the Sequential Secant Method can greatly improve its efficiency and robustness. In the present work, an R implementation of the method is presented. Numerical experiments with a widely used test bed compare the presented approach with its plain (i.e., non-accelerated) version that is part of the R package BB. Additional numerical experiments compare the proposed method with NITSOL, a state-of-the-art solver for nonlinear systems. These comparisons show that the acceleration process greatly improves the robustness of its counterpart included in the existing R package. As a by-product, an interface is provided between R and the consolidated CUTEst collection, which contains over a thousand nonlinear programming problems of all types and represents a standard for evaluating the performance of optimization methods.
引用
收藏
页码:609 / 624
页数:16
相关论文
共 25 条
  • [1] AN ALGORITHM FOR SOLVING NON-LINEAR EQUATIONS BASED ON THE SECANT METHOD
    BARNES, JGP
    [J]. COMPUTER JOURNAL, 1965, 8 (01) : 66 - 72
  • [2] 2-POINT STEP SIZE GRADIENT METHODS
    BARZILAI, J
    BORWEIN, JM
    [J]. IMA JOURNAL OF NUMERICAL ANALYSIS, 1988, 8 (01) : 141 - 148
  • [3] Nonmonotone spectral projected gradient methods on convex sets
    Birgin, EG
    Martínez, JM
    Raydan, M
    [J]. SIAM JOURNAL ON OPTIMIZATION, 2000, 10 (04) : 1196 - 1211
  • [4] Algorithm 813:: SPG -: Software for convex-constrained optimization
    Birgin, EG
    Martínez, JM
    Raydan, M
    [J]. ACM TRANSACTIONS ON MATHEMATICAL SOFTWARE, 2001, 27 (03): : 340 - 349
  • [5] SECANT ACCELERATION OF SEQUENTIAL RESIDUAL METHODS FOR SOLVING LARGE-SCALE NONLINEAR SYSTEMS OF EQUATIONS
    Birgin, Ernesto G.
    Martinez, J. M.
    [J]. SIAM JOURNAL ON NUMERICAL ANALYSIS, 2022, 60 (06) : 3145 - 3180
  • [6] Spectral Projected Gradient Methods: Review and Perspectives
    Birgin, Ernesto G.
    Martinez, Jose Mario
    Raydan, Marcos
    [J]. JOURNAL OF STATISTICAL SOFTWARE, 2014, 60 (03): : 1 - 21
  • [7] Birgin J.M., 2009, Encyclopedia of Optimization, P3652
  • [8] A LIMITED MEMORY ALGORITHM FOR BOUND CONSTRAINED OPTIMIZATION
    BYRD, RH
    LU, PH
    NOCEDAL, J
    ZHU, CY
    [J]. SIAM JOURNAL ON SCIENTIFIC COMPUTING, 1995, 16 (05) : 1190 - 1208
  • [9] Conn A.R., 1992, Lancelot A Fortran Package for Large-Scale Nonlinear Optimization (Release A)
  • [10] Dennis J., 1996, Numerical Methods for Unconstrained Optimization and Nonlinear Equations