Worst-case evaluation complexity of a quadratic penalty method for nonconvex optimization

被引:1
作者
Grapiglia, Geovani Nunes [1 ,2 ]
机构
[1] Catholic Univ Louvain, ICTEAM INMA, Louvain La Neuve, Belgium
[2] Catholic Univ Louvain, ICTEAM INMA, Ave Georges Lemaitre 4-6, Louvain La Neuve B-1348, Belgium
关键词
Nonlinear programming; quadratic penalty method; worst-case complexity; high-order methods; CONSTRAINED OPTIMIZATION; REGULARIZATION; ALGORITHM;
D O I
10.1080/10556788.2023.2189711
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
This paper addresses the worst-case evaluation complexity of a version of the standard quadratic penalty method for smooth non convex optimization problems with constraints. The method analysed allows inexact solution of the subproblems and do not require prior knowledge of the Lipschitz constants related with the problem. When an approximate feasible point is used as starting point, ( ) it is shown that the referred method takes at most O log(s(-1) 0 e(-2)) outer iterations to generate an e-approximate KKT point, where s(0) is the first penalty parameter. For equality constrained problems, this bound yields to an evaluation complexity bound of O (e(-4)), when s0 = e(-2) and suitable first-order methods are used as inner solvers. complexity bound of O (e(-(P+1)/P)) is established when appropriFor problems having only linear equality constraints, an evaluation ate P-order methods (P = 2) are used as inner solvers. Illustrative numerical results are also presented and corroborate the theoretical predictions.
引用
收藏
页码:781 / 803
页数:23
相关论文
共 29 条
[1]  
[Anonymous], 1967, Manage. Sci, DOI [10.1287/mnsc.13.5.344, DOI 10.1287/MNSC.13.5.344]
[2]   ON REGULARIZATION AND ACTIVE-SET METHODS WITH COMPLEXITY FOR CONSTRAINED OPTIMIZATION [J].
Birgin, E. G. ;
Martinez, J. M. .
SIAM JOURNAL ON OPTIMIZATION, 2018, 28 (02) :1367-1395
[3]   EVALUATION COMPLEXITY FOR NONLINEAR CONSTRAINED OPTIMIZATION USING UNSCALED KKT CONDITIONS AND HIGH-ORDER MODELS [J].
Birgin, E. G. ;
Gardenghi, J. L. ;
Martinez, J. M. ;
Santos, S. A. ;
Toint, Ph. L. .
SIAM JOURNAL ON OPTIMIZATION, 2016, 26 (02) :951-967
[4]  
Bueno L.F., 2018, COMPLEXITY INEXACT R
[5]   ON A METHOD OF COURANT FOR MINIMIZING FUNCTIONALS [J].
BUTLER, T ;
MARTIN, AV .
JOURNAL OF MATHEMATICS AND PHYSICS, 1962, 41 (04) :291-&
[6]   INEQUALITY-CONSTRAINED STATIONARY-VALUE PROBLEMS [J].
CAMP, GD .
JOURNAL OF THE OPERATIONS RESEARCH SOCIETY OF AMERICA, 1955, 3 (04) :548-550
[7]   On the complexity of finding first-order critical points in constrained nonlinear optimization (vol 144, pg 93, 2014) [J].
Cartis, C. ;
Gould, N. I. M. ;
Toint, Ph. L. .
MATHEMATICAL PROGRAMMING, 2017, 161 (1-2) :611-626
[8]   An adaptive cubic regularization algorithm for nonconvex optimization with convex constraints and its function-evaluation complexity [J].
Cartis, C. ;
Gould, N. I. M. ;
Toint, Ph. L. .
IMA JOURNAL OF NUMERICAL ANALYSIS, 2012, 32 (04) :1662-1695
[9]   Evaluation Complexity Bounds for Smooth Constrained Nonlinear Optimization Using Scaled KKT Conditions and High-Order Models [J].
Cartis, Coralia ;
Gould, Nicholas I. M. ;
Toint, Philippe L. .
APPROXIMATION AND OPTIMIZATION: ALGORITHMS, COMPLEXITY AND APPLICATIONS, 2019, 145 :5-26
[10]   On the complexity of finding first-order critical points in constrained nonlinear optimization [J].
Cartis, Coralia ;
Gould, Nicholas I. M. ;
Toint, Philippe L. .
MATHEMATICAL PROGRAMMING, 2014, 144 (1-2) :93-106