A REGULARIZED FACTORIZATION-FREE METHOD FOR EQUALITY-CONSTRAINED OPTIMIZATION

被引:12
|
作者
Arreckx, Sylvain [1 ,2 ]
Orban, Dominique [1 ,2 ]
机构
[1] Ecole Polytech, GERAD, Montreal, PQ H3C 3A7, Canada
[2] Ecole Polytech, Dept Math & Ind Engn, Montreal, PQ H3C 3A7, Canada
基金
加拿大自然科学与工程研究理事会;
关键词
sequential quadratic programming; regularization; augmented Lagrangian; limited-memory BFGS; factorization-free method; STABILIZED SQP METHOD; ALGORITHM; CONVERGENCE;
D O I
10.1137/16M1088570
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
We propose a method for equality-constrained optimization based on a problem in which all constraints are systematically regularized. The regularization is equivalent to applying an augmented Lagrangian method but the linear system used to compute a search direction is reminiscent of regularized sequential quadratic programming. A limited-memory BFGS approximation to second derivatives allows us to employ iterative methods for linear least squares to compute steps, resulting in a factorization-free implementation. We establish global and fast local convergence under weak assumptions. In particular, we do not require the LICQ and our method is suitable for degenerate problems. Preliminary numerical experiments show that a factorization-based implementation of our method exhibits significant robustness while a factorization-free implementation, though not as robust, is promising. We briefly discuss generalizing our framework to other classes of methods and to problems with inequality constraints.
引用
收藏
页码:1613 / 1639
页数:27
相关论文
共 50 条
  • [1] Canonical coordinates method for equality-constrained nonlinear optimization
    Chang, HC
    Prabhu, N
    APPLIED MATHEMATICS AND COMPUTATION, 2003, 140 (01) : 135 - 158
  • [2] A derivative-free trust-funnel method for equality-constrained nonlinear optimization
    Ph. R. Sampaio
    Ph. L. Toint
    Computational Optimization and Applications, 2015, 61 : 25 - 49
  • [3] A derivative-free trust-funnel method for equality-constrained nonlinear optimization
    Sampaio, Ph. R.
    Toint, Ph. L.
    COMPUTATIONAL OPTIMIZATION AND APPLICATIONS, 2015, 61 (01) : 25 - 49
  • [4] A globally convergent Levenberg–Marquardt method for equality-constrained optimization
    A. F. Izmailov
    M. V. Solodov
    E. I. Uskov
    Computational Optimization and Applications, 2019, 72 : 215 - 239
  • [5] Sequential equality-constrained optimization for nonlinear programming
    Birgin, E. G.
    Bueno, L. F.
    Martinez, J. M.
    COMPUTATIONAL OPTIMIZATION AND APPLICATIONS, 2016, 65 (03) : 699 - 721
  • [6] A globally convergent Levenberg-Marquardt method for equality-constrained optimization
    Izmailov, A. F.
    Solodov, M. V.
    Uskov, E. I.
    COMPUTATIONAL OPTIMIZATION AND APPLICATIONS, 2019, 72 (01) : 215 - 239
  • [7] Sequential equality-constrained optimization for nonlinear programming
    E. G. Birgin
    L. F. Bueno
    J. M. Martínez
    Computational Optimization and Applications, 2016, 65 : 699 - 721
  • [8] A line search penalty-free SQP method for equality-constrained optimization without Maratos effect
    Chen, Zhongwen
    Dai, Yu-Hong
    Zhang, Tauyou
    IMA JOURNAL OF NUMERICAL ANALYSIS, 2022, 42 (04) : 3771 - 3802
  • [9] Alternating Projected SGD for Equality-constrained Bilevel Optimization
    Xiao, Quan
    Shen, Han
    Yin, Wotao
    Chen, Tianyi
    INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND STATISTICS, VOL 206, 2023, 206
  • [10] ALESQP: AN AUGMENTED LAGRANGIAN EQUALITY-CONSTRAINED SQP METHOD FOR OPTIMIZATION WITH GENERAL CONSTRAINTS
    Antil, Harbir
    Kouri, Drew P.
    Ridzal, Denis
    SIAM JOURNAL ON OPTIMIZATION, 2023, 33 (01) : 237 - 266