A modified Hestenes-Stiefel conjugate gradient method with an optimal property

被引:20
作者
Amini, Keyvan [1 ]
Faramarzi, Parvaneh [1 ]
Pirfalah, Nasrin [1 ]
机构
[1] Razi Univ, Dept Math, Fac Sci, Kermanshah, Iran
关键词
unconstrained optimization; conjugate gradient method; sufficient descent condition; global convergence; SUFFICIENT DESCENT PROPERTY; GLOBAL CONVERGENCE; MINIMIZATION;
D O I
10.1080/10556788.2018.1457150
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
In this paper, based on the numerical efficiency of Hestenes-Stiefel (HS) method, a new modified HS algorithm is proposed for unconstrained optimization. The new direction independent of the line search satisfies in the sufficient descent condition. Motivated by theoretical and numerical features of three-term conjugate gradient (CG) methods proposed by Narushima etal., similar to Dai and Kou approach, the new direction is computed by minimizing the distance between the CG direction and the direction of the three-term CG methods proposed by Narushima etal. Under some mild conditions, we establish global convergence of the new method for general functions when the standard Wolfe line search is used. Numerical experiments on some test problems from the CUTEst collection are given to show the efficiency of the proposed method.
引用
收藏
页码:770 / 782
页数:13
相关论文
共 26 条
[21]   RESTART PROCEDURES FOR CONJUGATE GRADIENT METHOD [J].
POWELL, MJD .
MATHEMATICAL PROGRAMMING, 1977, 12 (02) :241-254
[22]  
POWELL MJD, 1984, LECT NOTES MATH, V1066, P122
[23]   CONVERGENCE OF A NEW CONJUGATE GRADIENT ALGORITHM [J].
SHANNO, DF .
SIAM JOURNAL ON NUMERICAL ANALYSIS, 1978, 15 (06) :1247-1257
[24]   Spectral conjugate gradient methods with sufficient descent property for large-scale unconstrained optimization [J].
Yu, Gaohang ;
Guan, Lutai ;
Chen, Wufan .
OPTIMIZATION METHODS & SOFTWARE, 2008, 23 (02) :275-293
[25]   Some descent three-term conjugate gradient methods and their global convergence [J].
Zhang, Li ;
Zhou, Weijun ;
Li, Donghui .
OPTIMIZATION METHODS & SOFTWARE, 2007, 22 (04) :697-711
[26]  
Zoutendijk G., 1970, Integer and nonlinear programming, P37