A family of hybrid conjugate gradient methods for unconstrained optimization

被引:28
作者
Dai, YH [1 ]
机构
[1] Chinese Acad Sci, Acad Math & Syst Sci, Inst Computat Math & Sci Engn Comp, State Key Lab Sci & Engn Comp, Beijing 100080, Peoples R China
关键词
unconstrained optimization; conjugate gradient method; line search; descent property; global convergence;
D O I
10.1090/S0025-5718-03-01491-1
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
Conjugate gradient methods are an important class of methods for unconstrained optimization, especially for large-scale problems. Recently, they have been much studied. This paper proposes a three-parameter family of hybrid conjugate gradient methods. Two important features of the family are that (i) it can avoid the propensity of small steps, namely, if a small step is generated away from the solution point, the next search direction will be close to the negative gradient direction; and (ii) its descent property and global convergence are likely to be achieved provided that the line search satisfies the Wolfe conditions. Some numerical results with the family are also presented.
引用
收藏
页码:1317 / 1328
页数:12
相关论文
共 24 条
[1]  
Broyden C.G., 1970, J I MATH ITS APPL, V6, P76, DOI DOI 10.1093/IMAMAT/6.1.76
[2]   GLOBAL CONVERGENCE OF A CLASS OF QUASI-NEWTON METHODS ON CONVEX PROBLEMS [J].
BYRD, RH ;
NOCEDAL, J ;
YUAN, YX .
SIAM JOURNAL ON NUMERICAL ANALYSIS, 1987, 24 (05) :1171-1190
[3]   Convergence properties of the Fletcher-Reeves method [J].
Dai, YH ;
Yuan, Y .
IMA JOURNAL OF NUMERICAL ANALYSIS, 1996, 16 (02) :155-164
[4]   Convergence properties of nonlinear conjugate gradient methods [J].
Dai, YH ;
Han, JY ;
Liu, GH ;
Sun, DF ;
Yin, HX ;
Yuan, YX .
SIAM JOURNAL ON OPTIMIZATION, 2000, 10 (02) :345-358
[5]   An efficient hybrid conjugate gradient method for unconstrained optimization [J].
Dai, YH ;
Yuan, Y .
ANNALS OF OPERATIONS RESEARCH, 2001, 103 (1-4) :33-47
[6]  
Dai YH, 2001, MATH COMPUT, V70, P1155, DOI 10.1090/S0025-5718-00-01253-9
[7]  
Dai YH, 2001, NUMER MATH, V89, P83, DOI 10.1007/s002110000253
[8]   A nonlinear conjugate gradient method with a strong global convergence property [J].
Dai, YH ;
Yuan, Y .
SIAM JOURNAL ON OPTIMIZATION, 1999, 10 (01) :177-182
[9]  
DAI YH, 2001, P 5 INT C OPT TECHN, P778
[10]  
DAI YH, 1998, IN PRESS SCI CHINA A