Some new facts about sequential quadratic programming methods employing second derivatives

被引:1
作者
Izmailov, A. F. [1 ,2 ,3 ]
Solodov, M. V. [4 ]
机构
[1] Lomonosov Moscow State Univ, MSU, Dept, VMK Fac, Uchebniy Korpus 2, Moscow 119991, Russia
[2] Peoples Friendship Univ Russia, Miklukho Maklaya Str 6, Moscow 117198, Russia
[3] Derzhavin Tambov State Univ, TSU, Dept Math Phys & Comp Sci, Int 33, Tambov 392000, Russia
[4] IMPA Inst Nacl Matemat Pura & Aplicada, Estr Dona Castorina 110, BR-22460320 Rio De Janeiro, Brazil
基金
俄罗斯科学基金会; 俄罗斯基础研究基金会;
关键词
sequential quadratic programming; penalty function; descent direction; quadratic convergence; EQUALITY CONSTRAINED OPTIMIZATION; SQP METHOD; GLOBAL CONVERGENCE;
D O I
10.1080/10556788.2016.1177528
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
For the sequential quadratic programming method (SQP), we show that close to a solution satisfying the same assumptions that are required for its local quadratic convergence (namely uniqueness of the Lagrange multipliers and the second-order sufficient optimality condition), the direction given by the SQP subproblem using the Hessian of the Lagrangian is a descent direction for the standard l(1)-penalty function. We emphasize that this property is not straightforward at all, because the Hessian of the Lagrangian need not be positive definite under these assumptions or, in fact, under any other reasonable set of assumptions. In particular, this descent property was not known previously, under any assumptions (even including the stronger linear independence constraint qualification, strict complementarity, etc.). We also check the property in question by experiments on nonconvex problems from the Hock-Schittkowski test collection for a model algorithm. While to propose any new and complete SQP algorithm is not our goal here, our experiments confirm that the descent condition, and a model method based on it, work as expected. This indicates that the new theoretical findings that we report might be useful for full/practical SQP implementations which employ second derivatives and linesearch for the l(1)-penalty function. In particular, our results imply that in SQP methods where using subproblems without Hessian modifications is an option, this option has a solid theoretical justification at least on late iterations.
引用
收藏
页码:1111 / 1131
页数:21
相关论文
共 19 条
  • [1] [Anonymous], 1981, Practical optimization
  • [2] [Anonymous], 1996, ACTA NUMER
  • [3] [Anonymous], SPRINGER SERIES OPER
  • [4] A ROBUST SEQUENTIAL QUADRATIC-PROGRAMMING METHOD
    BURKE, JV
    HAN, SP
    [J]. MATHEMATICAL PROGRAMMING, 1989, 43 (03) : 277 - 303
  • [5] An inexact SQP method for equality constrained optimization
    Byrd, Richard H.
    Curtis, Frank E.
    Nocedal, Jorge
    [J]. SIAM JOURNAL ON OPTIMIZATION, 2008, 19 (01) : 351 - 369
  • [6] An inexact Newton method for nonconvex equality constrained optimization
    Byrd, Richard H.
    Curtis, Frank E.
    Nocedal, Jorge
    [J]. MATHEMATICAL PROGRAMMING, 2010, 122 (02) : 273 - 299
  • [7] SHARP PRIMAL SUPERLINEAR CONVERGENCE RESULTS FOR SOME NEWTONIAN METHODS FOR CONSTRAINED OPTIMIZATION
    Fernandez, D.
    Izmailov, A. F.
    Solodov, M. V.
    [J]. SIAM JOURNAL ON OPTIMIZATION, 2010, 20 (06) : 3312 - 3334
  • [8] Gould N, 2005, ACT NUMERIC, V14, P299, DOI 10.1017/S0962492904000248
  • [9] A SECOND DERIVATIVE SQP METHOD: LOCAL CONVERGENCE AND PRACTICAL ISSUES
    Gould, Nicholas I. M.
    Robinson, Daniel P.
    [J]. SIAM JOURNAL ON OPTIMIZATION, 2010, 20 (04) : 2049 - 2079
  • [10] A SECOND DERIVATIVE SQP METHOD: GLOBAL CONVERGENCE
    Gould, Nicholas I. M.
    Robinson, Daniel P.
    [J]. SIAM JOURNAL ON OPTIMIZATION, 2010, 20 (04) : 2023 - 2048