GLOBAL CONVERGENCE PROPERTIES OF CONJUGATE GRADIENT METHODS FOR OPTIMIZATION

被引：751

作者：

Gilbert, Jean Charles ^{[1
]}

Nocedal, Jorge ^{[2
]}

机构：

[1] Inst Natl Rech Informat & Automat, F-78153 Le Chesnay, France

[2] Northwestern Univ, Dept Elect Engn & Comp Sci, Evanston, IL 60208 USA

来源：

SIAM JOURNAL ON OPTIMIZATION | 1992年 / 2卷 / 01期

基金：

美国国家科学基金会; 美国能源部;

关键词：

conjugate gradient method; global convergence; unconstrained optimization; large-scale optimization;

D O I：

10.1137/0802003

中图分类号：

O29 [应用数学];

学科分类号：

070104 ;

摘要：

This paper explores the convergence of nonlinear conjugate gradient methods without restarts, and with practical line searches. The analysis covers two classes of methods that are globally convergent on smooth, nonconvex functions. Some properties of the Fletcher-Reeves method play an important role in the first family, whereas the second family shares an important property with the Polak-Ribiere method. Numerical experiments are presented.

引用

页码：21 / 42

页数：22

共 27 条

[1] DESCENT PROPERTY AND GLOBAL CONVERGENCE OF THE FLETCHER REEVES METHOD WITH INEXACT LINE SEARCH [J].

ALBAALI, M .

IMA JOURNAL OF NUMERICAL ANALYSIS, 1985, 5 (01) :121-124

[2] RELATION BETWEEN QUADRATIC TERMINATION AND CONVERGENCE PROPERTIES OF MINIMIZATION ALGORITHMS .2. APPLICATIONS [J].

BAPTIST, P ;

STOER, J .

NUMERISCHE MATHEMATIK, 1977, 28 (04) :367-391

[3] QN-LIKE VARIABLE STORAGE CONJUGATE GRADIENTS [J].

BUCKLEY, A ;

LENIR, A .

MATHEMATICAL PROGRAMMING, 1983, 27 (02) :155-175

[4] RATE OF CONVERGENCE OF SEVERAL CONJUGATE GRADIENT ALGORITHMS [J].

COHEN, AI .

SIAM JOURNAL ON NUMERICAL ANALYSIS, 1972, 9 (02) :248-&

[5] LINEAR CONVERGENCE OF CONJUGATE GRADIENT METHOD [J].

CROWDER, H ;

WOLFE, P .

IBM JOURNAL OF RESEARCH AND DEVELOPMENT, 1972, 16 (04) :431-&

[6] FUNCTION MINIMIZATION BY CONJUGATE GRADIENTS [J].

FLETCHER, R ;

REEVES, CM .

COMPUTER JOURNAL, 1964, 7 (02) :149-&

[7]

FLETCHER R, PRACTICAL METHODS OP

[8] SOME NUMERICAL EXPERIMENTS WITH VARIABLE-STORAGE QUASI-NEWTON ALGORITHMS [J].

GILBERT, JC ;

LEMARECHAL, C .

MATHEMATICAL PROGRAMMING, 1989, 45 (03) :407-435

[9]

Gill P. E., 1981, PRACTICAL OPTIMIZATI

[10]

GILL PE, 1973, RECENT MATH DEV CONT, P97

← 1 2 3 →