A modified Hestenes-Stiefel conjugate gradient method with an optimal property

被引:20
作者
Amini, Keyvan [1 ]
Faramarzi, Parvaneh [1 ]
Pirfalah, Nasrin [1 ]
机构
[1] Razi Univ, Dept Math, Fac Sci, Kermanshah, Iran
关键词
unconstrained optimization; conjugate gradient method; sufficient descent condition; global convergence; SUFFICIENT DESCENT PROPERTY; GLOBAL CONVERGENCE; MINIMIZATION;
D O I
10.1080/10556788.2018.1457150
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
In this paper, based on the numerical efficiency of Hestenes-Stiefel (HS) method, a new modified HS algorithm is proposed for unconstrained optimization. The new direction independent of the line search satisfies in the sufficient descent condition. Motivated by theoretical and numerical features of three-term conjugate gradient (CG) methods proposed by Narushima etal., similar to Dai and Kou approach, the new direction is computed by minimizing the distance between the CG direction and the direction of the three-term CG methods proposed by Narushima etal. Under some mild conditions, we establish global convergence of the new method for general functions when the standard Wolfe line search is used. Numerical experiments on some test problems from the CUTEst collection are given to show the efficiency of the proposed method.
引用
收藏
页码:770 / 782
页数:13
相关论文
共 26 条
[1]   DESCENT PROPERTY AND GLOBAL CONVERGENCE OF THE FLETCHER REEVES METHOD WITH INEXACT LINE SEARCH [J].
ALBAALI, M .
IMA JOURNAL OF NUMERICAL ANALYSIS, 1985, 5 (01) :121-124
[2]   CUTE - CONSTRAINED AND UNCONSTRAINED TESTING ENVIRONMENT [J].
BONGARTZ, I ;
CONN, AR ;
GOULD, N ;
TOINT, PL .
ACM TRANSACTIONS ON MATHEMATICAL SOFTWARE, 1995, 21 (01) :123-160
[3]  
Dai Y.-H., 2011, WILEY ENCY OPERATION, DOI [10.1002/9780470400531.eorms0183, DOI 10.1002/9780470400531.EORMS0183]
[4]   Convergence properties of nonlinear conjugate gradient methods [J].
Dai, YH ;
Han, JY ;
Liu, GH ;
Sun, DF ;
Yin, HX ;
Yuan, YX .
SIAM JOURNAL ON OPTIMIZATION, 2000, 10 (02) :345-358
[5]   New conjugacy conditions and related nonlinear conjugate gradient methods [J].
Dai, YH ;
Liao, LZ .
APPLIED MATHEMATICS AND OPTIMIZATION, 2001, 43 (01) :87-101
[6]   A nonlinear conjugate gradient method with a strong global convergence property [J].
Dai, YH ;
Yuan, Y .
SIAM JOURNAL ON OPTIMIZATION, 1999, 10 (01) :177-182
[7]   A NONLINEAR CONJUGATE GRADIENT ALGORITHM WITH AN OPTIMAL PROPERTY AND AN IMPROVED WOLFE LINE SEARCH [J].
Dai, Yu-Hong ;
Kou, Cai-Xia .
SIAM JOURNAL ON OPTIMIZATION, 2013, 23 (01) :296-320
[8]   Benchmarking optimization software with performance profiles [J].
Dolan, ED ;
Moré, JJ .
MATHEMATICAL PROGRAMMING, 2002, 91 (02) :201-213
[9]   FUNCTION MINIMIZATION BY CONJUGATE GRADIENTS [J].
FLETCHER, R ;
REEVES, CM .
COMPUTER JOURNAL, 1964, 7 (02) :149-&
[10]   GLOBAL CONVERGENCE PROPERTIES OF CONJUGATE GRADIENT METHODS FOR OPTIMIZATION [J].
Gilbert, Jean Charles ;
Nocedal, Jorge .
SIAM JOURNAL ON OPTIMIZATION, 1992, 2 (01) :21-42