Second-Order Optimality and Beyond: Characterization and Evaluation Complexity in Convexly Constrained Nonlinear Optimization

被引:24
作者
Cartis, Coralia [1 ]
Gould, Nick I. M. [2 ]
Toint, Philippe L. [3 ,4 ]
机构
[1] Univ Oxford, Math Inst, Oxford OX2 6GG, England
[2] Rutherford Appleton Lab, Numer Anal Grp, Chilton OX11 0QX, England
[3] Univ Namur, Namur Ctr Complex Syst naXys, 61 Rue Bruxelles, B-5000 Namur, Belgium
[4] Univ Namur, Dept Math, 61 Rue Bruxelles, B-5000 Namur, Belgium
基金
英国工程与自然科学研究理事会;
关键词
Nonlinear optimization; High-order optimality conditions; Complexity theory; Machine learning; WORST-CASE COMPLEXITY; TRUST-REGION METHODS; CUBIC REGULARIZATION; LEAST-SQUARES; ALGORITHMS; BOUNDS; ORDER; SET;
D O I
10.1007/s10208-017-9363-y
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
High-order optimality conditions for convexly constrained nonlinear optimization problems are analysed. A corresponding (expensive) measure of criticality for arbitrary order is proposed and extended to define high-order -approximate critical points. This new measure is then used within a conceptual trust-region algorithm to show that if derivatives of the objective function up to order can be evaluated and are Lipschitz continuous, then this algorithm applied to the convexly constrained problem needs at most evaluations of f and its derivatives to compute an -approximate qth-order critical point. This provides the first evaluation complexity result for critical points of arbitrary order in nonlinear optimization. An example is discussed, showing that the obtained evaluation complexity bounds are essentially sharp.
引用
收藏
页码:1073 / 1107
页数:35
相关论文
共 55 条
  • [1] Anandkumar A., 2016, ARXIV 1602 05908
  • [2] [Anonymous], TECHNICAL REPORT
  • [3] [Anonymous], SERIES OPERATIONS RE
  • [4] [Anonymous], 1996, Die Grundlehren der mathematischen Wissenschaften
  • [5] [Anonymous], 1884, Calcolo Differenziale e Principii di Calcolo Integrale
  • [6] Auslender A., 1990, Optimization, V21, P351, DOI 10.1080/02331939008843555
  • [7] Baes M., 2009, ESTIMATE SEQUENCEMET
  • [9] Bian W., 2015, TECHNICAL REPORT
  • [10] Complexity analysis of interior point algorithms for non-Lipschitz and nonconvex minimization
    Bian, Wei
    Chen, Xiaojun
    Ye, Yinyu
    [J]. MATHEMATICAL PROGRAMMING, 2015, 149 (1-2) : 301 - 327