Newton methods for nonsmooth convex minimization:: connections among U-Lagrangian, Riemannian Newton and SQP methods

被引:32
作者
Miller, SA
Malick, J
机构
[1] Numer Corp, Ft Collins, CO 80527 USA
[2] INRIA, F-38334 Saint Ismier, France
关键词
D O I
10.1007/s10107-005-0631-2
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
This paper studies Newton-type methods for minimization of partly smooth convex functions. Sequential Newton methods are provided using local parameterizations obtained from U-Lagrangian theory and from Riemannian geometry. The Hessian based on the U-Lagrangian depends on the selection of a dual parameter g; by revealing the connection to Riemannian geometry, a natural choice of g emerges for which the two Newton directions coincide. This choice of g is also shown to be related to the least-squares multiplier estimate from a sequential quadratic programming (SQP) approach, and with this multiplier, SQP gives the same search direction as the Newton methods.
引用
收藏
页码:609 / 633
页数:25
相关论文
共 27 条
[1]  
[Anonymous], 1992, RIEMANNIAN GEOMETRY
[2]  
Bonnans J.-F., 2006, Numerical Optimization: Theoretical and Practical Aspects
[3]  
CHAMBERLAIN RM, 1982, MATH PROGRAM STUD, V16, P1
[4]   Newton's method on Riemannian manifolds: covariant alpha theory [J].
Dedieu, JP ;
Priouret, P ;
Malajovich, G .
IMA JOURNAL OF NUMERICAL ANALYSIS, 2003, 23 (03) :395-419
[5]   QUASI-NEWTON METHODS, MOTIVATION AND THEORY [J].
DENNIS, JE ;
MORE, JJ .
SIAM REVIEW, 1977, 19 (01) :46-89
[6]   The geometry of algorithms with orthogonality constraints [J].
Edelman, A ;
Arias, TA ;
Smith, ST .
SIAM JOURNAL ON MATRIX ANALYSIS AND APPLICATIONS, 1998, 20 (02) :303-353
[7]   MINIMIZING A DIFFERENTIABLE FUNCTION OVER A DIFFERENTIAL MANIFOLD [J].
GABAY, D .
JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 1982, 37 (02) :177-217
[8]  
HARE W, 2005, IN PRESS J COMPUT OP
[9]  
HIRIARTURRUTY JB, 1993, GRUNDLEHREN MATH WIS, V305
[10]  
Lee J. M, 1997, GRADUATE TEXTS MATH, V176