A new family of conjugate gradient methods for unconstrained optimization

被引:12
作者
Li, Ming [1 ]
Liu, Hongwei [1 ]
Liu, Zexian [2 ]
机构
[1] Xidian Univ, Coll Math & Stat, Xian 710071, Shaanxi, Peoples R China
[2] Hezhou Univ, Sch Math & Comp Sci, Hezhou 542899, Guangxi, Peoples R China
基金
中国国家自然科学基金;
关键词
Conjugate gradient method; Sufficient descent property; Global convergence; Unconstrained optimization; LINE SEARCH; ALGORITHM; CONVERGENCE; PROPERTY;
D O I
10.1007/s12190-017-1141-0
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
A new family of conjugate gradient methods is proposed by minimizing the distance between two certain directions. It is a subfamily of Dai-Liao family, which consists of Hager-Zhang family and Dai-Kou method. The direction of the proposed method is an approximation to that of the memoryless Broyden-Fletcher- Goldfarb-Shanno method. With the suitable intervals of parameters, the direction of the proposed method possesses the sufficient descent property independent of the line search. Under mild assumptions, we analyze the global convergence of the method for strongly convex functions and general functions where the stepsize is obtained by the standard Wolfe rules. Numerical results indicate that the proposed method is a promising method which outperforms CGOPT and CG_DESCENT on a set of unconstrained optimization testing problems.
引用
收藏
页码:219 / 234
页数:16
相关论文
共 29 条
[1]   An adaptive conjugate gradient algorithm for large-scale unconstrained optimization [J].
Andrei, Neculai .
JOURNAL OF COMPUTATIONAL AND APPLIED MATHEMATICS, 2016, 292 :83-91
[2]  
Andrei N, 2011, B MALAYS MATH SCI SO, V34, P319
[3]  
[Anonymous], 2008, ENV SCI TECHNOLOGY
[4]  
[Anonymous], 2009, CONJUGATE GRADIENT A
[5]  
[Anonymous], 1999, NUMERICAL OPTIMIZATI, DOI DOI 10.1007/B98874
[6]   The Dai-Liao nonlinear conjugate gradient method with optimal parameter choices [J].
Babaie-Kafaki, Saman ;
Ghanbari, Reza .
EUROPEAN JOURNAL OF OPERATIONAL RESEARCH, 2014, 234 (03) :625-630
[7]   2-POINT STEP SIZE GRADIENT METHODS [J].
BARZILAI, J ;
BORWEIN, JM .
IMA JOURNAL OF NUMERICAL ANALYSIS, 1988, 8 (01) :141-148
[8]   CUTE - CONSTRAINED AND UNCONSTRAINED TESTING ENVIRONMENT [J].
BONGARTZ, I ;
CONN, AR ;
GOULD, N ;
TOINT, PL .
ACM TRANSACTIONS ON MATHEMATICAL SOFTWARE, 1995, 21 (01) :123-160
[9]   New conjugacy conditions and related nonlinear conjugate gradient methods [J].
Dai, YH ;
Liao, LZ .
APPLIED MATHEMATICS AND OPTIMIZATION, 2001, 43 (01) :87-101
[10]   A nonlinear conjugate gradient method with a strong global convergence property [J].
Dai, YH ;
Yuan, Y .
SIAM JOURNAL ON OPTIMIZATION, 1999, 10 (01) :177-182