An inexact Newton method for nonconvex equality constrained optimization

被引:33
|
作者
Byrd, Richard H. [2 ]
Curtis, Frank E. [1 ]
Nocedal, Jorge [3 ]
机构
[1] Northwestern Univ, Dept Ind Engn & Management Sci, Evanston, IL 60208 USA
[2] Univ Colorado, Dept Comp Sci, Boulder, CO 80309 USA
[3] Northwestern Univ, Dept Elect Engn & Comp Sci, Evanston, IL 60208 USA
基金
美国国家科学基金会;
关键词
Large-scale optimization; Constrained optimization; Nonconvex programming; Inexact linear system solvers; Krylov subspace methods; CONVERGENCE; 2ND-ORDER; ALGORITHM; POINT;
D O I
10.1007/s10107-008-0248-3
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
We present a matrix-free line search algorithm for large-scale equality constrained optimization that allows for inexact step computations. For strictly convex problems, the method reduces to the inexact sequential quadratic programming approach proposed by Byrd et al. [SIAM J. Optim. 19(1) 351-369, 2008]. For nonconvex problems, the methodology developed in this paper allows for the presence of negative curvature without requiring information about the inertia of the primal-dual iteration matrix. Negative curvature may arise from second-order information of the problem functions, but in fact exact second derivatives are not required in the approach. The complete algorithm is characterized by its emphasis on sufficient reductions in a model of an exact penalty function. We analyze the global behavior of the algorithm and present numerical results on a collection of test problems.
引用
收藏
页码:273 / 299
页数:27
相关论文
共 50 条
  • [31] A NEWTON-CG BASED AUGMENTED LAGRANGIAN METHOD FOR FINDING A SECOND-ORDER STATIONARY POINT OF NONCONVEX EQUALITY CONSTRAINED OPTIMIZATION WITH COMPLEXITY GUARANTEES
    He, Chuan
    Lu, Zhaosong
    Pong, Ting Kei
    SIAM JOURNAL ON OPTIMIZATION, 2023, 33 (03) : 1734 - 1766
  • [32] An improved inexact Newton's method for unary optimization
    Deng, NY
    Wang, ZZ
    Zhang, JZ
    OPTIMIZATION METHODS & SOFTWARE, 2001, 15 (3-4): : 257 - 282
  • [33] ON THE COMPLEXITY OF AN INEXACT RESTORATION METHOD FOR CONSTRAINED OPTIMIZATION
    Bueno, Luis Felipe
    Martinez, Jose Mario
    SIAM JOURNAL ON OPTIMIZATION, 2020, 30 (01) : 80 - 101
  • [34] An improved inexact Newton's method for unary optimization
    Deng, Naiyang
    Wang, Zhaozhi
    Zhang, Jianzhong
    Optimization Methods and Software, 2002, 15 (3-4) : 257 - 282
  • [35] A Dual Inexact Nonsmooth Newton Method for Distributed Optimization
    Niu, Dunbiao
    Hong, Yiguang
    Song, Enbin
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2025, 73 : 188 - 203
  • [36] Stochastic inexact augmented Lagrangian method for nonconvex expectation constrained optimization (vol 87, pg 117, 2024)
    Li, Zichong
    Chen, Pin-Yu
    Liu, Sijia
    Lu, Songtao
    Xu, Yangyang
    COMPUTATIONAL OPTIMIZATION AND APPLICATIONS, 2024, 89 (02) : 575 - 578
  • [37] Fast Newton Hard Thresholding Pursuit for Sparsity Constrained Nonconvex Optimization
    Chen, Jinghui
    Gu, Quanquan
    KDD'17: PROCEEDINGS OF THE 23RD ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, 2017, : 757 - 766
  • [38] A proximal bundle method-based algorithm with penalty strategy and inexact oracles for constrained nonsmooth nonconvex optimization
    Wang, Xiaoliang
    Pang, Liping
    Xiao, Xiantao
    JOURNAL OF COMPUTATIONAL AND APPLIED MATHEMATICS, 2023, 422
  • [39] A truncated SQP algorithm for solving nonconvex equality constrained optimization problems
    Chauvier, L
    Fuduli, A
    Gilbert, JC
    HIGH PERFORMANCE ALGORITHMS AND SOFTWARE FOR NONLINEAR OPTIMIZATION, 2003, 82 : 149 - 176
  • [40] Bundle Method for Nonconvex Nonsmooth Constrained Optimization
    Minh Ngoc Dao
    JOURNAL OF CONVEX ANALYSIS, 2015, 22 (04) : 1061 - 1090