Convergence of the BFGS method for LC(1) convex constrained optimization

被引:24
作者
Chen, XJ
机构
[1] School of Mathematics, University of New South Wales, Sydney
关键词
quasi-Newton methods; convex programming; nonsmooth equations;
D O I
10.1137/S0363012994274823
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper proposes a BFGS-SQP method for linearly constrained optimization where the objective function f is required only to have a Lipschitz gradient. The Karush-Kuhn-Tucker system of the problem is equivalent to a system of nonsmooth equations F(v) = 0. At every step a quasi-Newton matrix is updated if \\F(v(k))\\ satisfies a rule. This method converges globally, and the rate of convergence is superlinear when f is twice strongly differentiable at a solution of the optimization problem. No assumptions on the constraints are required. This generalizes the classical convergence theory of the BFGS method, which requires a twice continuous differentiability assumption on the objective function. Applications to stochastic programs with recourse on a CM5 parallel computer are discussed.
引用
收藏
页码:2051 / 2063
页数:13
相关论文
共 36 条
[1]  
Bertsekas D.P, 1982, COMPUTER SCI APPL MA
[2]   A FAMILY OF VARIABLE-METRIC PROXIMAL METHODS [J].
BONNANS, JF ;
GILBERT, JC ;
LEMARECHAL, C ;
SAGASTIZABAL, CA .
MATHEMATICAL PROGRAMMING, 1995, 68 (01) :15-47
[3]  
Broyden C. G., 1973, Journal of the Institute of Mathematics and Its Applications, V12, P223
[4]   A TOOL FOR THE ANALYSIS OF QUASI-NEWTON METHODS WITH APPLICATION TO UNCONSTRAINED MINIMIZATION [J].
BYRD, RH ;
NOCEDAL, J .
SIAM JOURNAL ON NUMERICAL ANALYSIS, 1989, 26 (03) :727-739
[5]   ON THE CONVERGENCE OF SOME QUASI-NEWTON METHODS FOR NONLINEAR EQUATIONS WITH NONDIFFERENTIABLE OPERATORS [J].
CHEN, X ;
YAMAMOTO, T .
COMPUTING, 1992, 49 (01) :87-94
[6]   ON THE CONVERGENCE OF BROYDEN-LIKE METHODS FOR NONLINEAR EQUATIONS WITH NONDIFFERENTIABLE TERMS [J].
CHEN, X .
ANNALS OF THE INSTITUTE OF STATISTICAL MATHEMATICS, 1990, 42 (02) :387-401
[7]  
CHEN X, 1996, IN PRESS ANN OPER RE
[8]  
CHEN X, 1994, COMPUT OPTIM APPL, V3, P157, DOI DOI 10.1007/BF01300972
[9]   NEWTONS METHOD FOR QUADRATIC STOCHASTIC PROGRAMS WITH RECOURSE [J].
CHEN, XJ ;
QI, LQ ;
WOMERSLEY, RS .
JOURNAL OF COMPUTATIONAL AND APPLIED MATHEMATICS, 1995, 60 (1-2) :29-46
[10]  
Dennis, 1996, NUMERICAL METHODS UN