A REGULARIZED FACTORIZATION-FREE METHOD FOR EQUALITY-CONSTRAINED OPTIMIZATION

被引:13
作者
Arreckx, Sylvain [1 ,2 ]
Orban, Dominique [1 ,2 ]
机构
[1] Ecole Polytech, GERAD, Montreal, PQ H3C 3A7, Canada
[2] Ecole Polytech, Dept Math & Ind Engn, Montreal, PQ H3C 3A7, Canada
基金
加拿大自然科学与工程研究理事会;
关键词
sequential quadratic programming; regularization; augmented Lagrangian; limited-memory BFGS; factorization-free method; STABILIZED SQP METHOD; ALGORITHM; CONVERGENCE;
D O I
10.1137/16M1088570
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
We propose a method for equality-constrained optimization based on a problem in which all constraints are systematically regularized. The regularization is equivalent to applying an augmented Lagrangian method but the linear system used to compute a search direction is reminiscent of regularized sequential quadratic programming. A limited-memory BFGS approximation to second derivatives allows us to employ iterative methods for linear least squares to compute steps, resulting in a factorization-free implementation. We establish global and fast local convergence under weak assumptions. In particular, we do not require the LICQ and our method is suitable for degenerate problems. Preliminary numerical experiments show that a factorization-based implementation of our method exhibits significant robustness while a factorization-free implementation, though not as robust, is promising. We briefly discuss generalizing our framework to other classes of methods and to problems with inequality constraints.
引用
收藏
页码:1613 / 1639
页数:27
相关论文
共 46 条
[1]   Damped techniques for enforcing convergence of quasi-Newton methods [J].
Al-Baali, Mehiddin .
OPTIMIZATION METHODS & SOFTWARE, 2014, 29 (05) :919-936
[2]  
[Anonymous], 2003, AMPL: A Modeling Language for Mathematical Programming
[3]  
[Anonymous], 1996, NUMERICAL METHODS UN, DOI [10.1137/1.9781611971200, DOI 10.1137/1.9781611971200]
[4]  
[Anonymous], 2012, IMA VOL MATH APPL
[5]   A globally and quadratically convergent primal-dual augmented Lagrangian algorithm for equality constrained optimization [J].
Armand, Paul ;
Omheni, Riadh .
OPTIMIZATION METHODS & SOFTWARE, 2017, 32 (01) :1-21
[6]   Study of a primal-dual algorithm for equality constrained minimization [J].
Armand, Paul ;
Benoist, Joel ;
Omheni, Riadh ;
Pateloup, Vincent .
COMPUTATIONAL OPTIMIZATION AND APPLICATIONS, 2014, 59 (03) :405-433
[7]   From global to local convergence of interior methods for nonlinear optimization [J].
Armand, Paul ;
Benoist, Joel ;
Orban, Dominique .
OPTIMIZATION METHODS & SOFTWARE, 2013, 28 (05) :1051-1080
[8]  
Arreckx S., 2016, CAHIER GERAD
[9]  
Bertsekas D. P., 1996, CONSTRAINED OPTIMIZA, DOI [10.1016/b978-0-12-093480-5.50005-2, DOI 10.1016/B978-0-12-093480-5.50005-2]
[10]  
Birgin EG, 2014, FUND ALGORITHMS, P1, DOI 10.1137/1.9781611973365