Modification of the wolfe line search rules to satisfy the descent condition in the polak-ribiere-polyak conjugate gradient method

被引:3
作者
Armand, P. [1 ]
Di Pillo, G. [1 ]
机构
[1] Univ Limoges, F-87065 Limoges, France
关键词
conjugate gradient method; line search algorithm; unconstrained optimization;
D O I
10.1007/s10957-006-9123-7
中图分类号
C93 [管理学]; O22 [运筹学];
学科分类号
070105 ; 12 ; 1201 ; 1202 ; 120202 ;
摘要
This paper proposes a line search technique to satisfy a relaxed form of the strong Wolfe conditions in order to guarantee the descent condition at each iteration of the Polak-Ribiere-Polyak conjugate gradient algorithm. It is proved that this line search algorithm preserves the usual convergence properties of any descent algorithm. In particular, it is shown that the Zoutendijk condition holds under mild assumptions. It is also proved that the resulting conjugate gradient algorithm is convergent under a strong convexity assumption. For the nonconvex case, a globally convergent modification is proposed. Numerical tests are presented.
引用
收藏
页码:287 / 305
页数:19
相关论文
共 21 条
[1]   AN EFFICIENT LINE SEARCH FOR NONLINEAR LEAST-SQUARES [J].
ALBAALI, M ;
FLETCHER, R .
JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 1986, 48 (03) :359-377
[2]   A piecewise line-search technique for maintaining the positive definitenes of the matrices in the SQP method [J].
Armand, P ;
Gilbert, JC .
COMPUTATIONAL OPTIMIZATION AND APPLICATIONS, 2000, 16 (02) :121-158
[3]   Convergence properties of the Fletcher-Reeves method [J].
Dai, YH ;
Yuan, Y .
IMA JOURNAL OF NUMERICAL ANALYSIS, 1996, 16 (02) :155-164
[4]  
Dai YH, 2002, J COMPUT MATH, V20, P575
[5]   A nonlinear conjugate gradient method with a strong global convergence property [J].
Dai, YH ;
Yuan, Y .
SIAM JOURNAL ON OPTIMIZATION, 1999, 10 (01) :177-182
[6]   FUNCTION MINIMIZATION BY CONJUGATE GRADIENTS [J].
FLETCHER, R ;
REEVES, CM .
COMPUTER JOURNAL, 1964, 7 (02) :149-&
[7]  
Fletcher R., 1981, PRACTICAL METHODS OP
[8]  
GILBERT JC, 1996, ADV NONLINEAR PROGRA, P73
[9]   GLOBAL CONVERGENCE PROPERTIES OF CONJUGATE GRADIENT METHODS FOR OPTIMIZATION [J].
Gilbert, Jean Charles ;
Nocedal, Jorge .
SIAM JOURNAL ON OPTIMIZATION, 1992, 2 (01) :21-42
[10]   CUTEr and SifDec: a constrained and unconstrained testing environment, revisited [J].
Gould, NIM ;
Orban, D ;
Toint, PL .
ACM TRANSACTIONS ON MATHEMATICAL SOFTWARE, 2003, 29 (04) :373-394