A new three-term spectral conjugate gradient algorithm with higher numerical performance for solving large scale optimization problems based on Quasi-Newton equation

被引:2
作者
Guo, Jie [1 ]
Wan, Zhong [1 ]
机构
[1] Cent South Univ, Sch Math & Stat, Changsha, Hunan, Peoples R China
基金
中国国家自然科学基金;
关键词
High performance computing; optimization algorithm; conjugate gradient method; convergence analysis; GLOBAL CONVERGENCE; DESCENT;
D O I
10.1142/S1793962321500537
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
A new spectral three-term conjugate gradient algorithm in virtue of the Quasi-Newton equation is developed for solving large-scale unconstrained optimization problems. It is proved that the search directions in this algorithm always satisfy a sufficiently descent condition independent of any line search. Global convergence is established for general objective functions if the strong Wolfe line search is used. Numerical experiments are employed to show its high numerical performance in solving large-scale optimization problems. Particularly, the developed algorithm is implemented to solve the 100 benchmark test problems from CUTE with different sizes from 1000 to 10,000, in comparison with some similar ones in the literature. The numerical results demonstrate that our algorithm outperforms the state-of-the-art ones in terms of less CPU time, less number of iteration or less number of function evaluation.
引用
收藏
页数:14
相关论文
共 29 条
[1]   DESCENT PROPERTY AND GLOBAL CONVERGENCE OF THE FLETCHER REEVES METHOD WITH INEXACT LINE SEARCH [J].
ALBAALI, M .
IMA JOURNAL OF NUMERICAL ANALYSIS, 1985, 5 (01) :121-124
[2]  
Andrei N., 2008, ADV MODEL OPTIM, V10, P147, DOI [DOI 10.1021/ES702781X, DOI 10.1002/ADEM.200890003]
[3]   On three-term conjugate gradient algorithms for unconstrained optimization [J].
Andrei, Neculai .
APPLIED MATHEMATICS AND COMPUTATION, 2013, 219 (11) :6316-6327
[4]   A simple three-term conjugate gradient algorithm for unconstrained optimization [J].
Andrei, Neculai .
JOURNAL OF COMPUTATIONAL AND APPLIED MATHEMATICS, 2013, 241 :19-29
[5]   A modified Polak-Ribiere-Polyak conjugate gradient algorithm for unconstrained optimization [J].
Andrei, Neculai .
OPTIMIZATION, 2011, 60 (12) :1457-1471
[6]   Two new conjugate gradient methods based on modified secant equations [J].
Babaie-Kafaki, Saman ;
Ghanbari, Reza ;
Mandavi-Amiri, Nezam .
JOURNAL OF COMPUTATIONAL AND APPLIED MATHEMATICS, 2010, 234 (05) :1374-1386
[7]   CUTE - CONSTRAINED AND UNCONSTRAINED TESTING ENVIRONMENT [J].
BONGARTZ, I ;
CONN, AR ;
GOULD, N ;
TOINT, PL .
ACM TRANSACTIONS ON MATHEMATICAL SOFTWARE, 1995, 21 (01) :123-160
[8]  
Deng SH, 2019, PAC J OPTIM, V15, P237
[9]   An Improved Spectral Conjugate Gradient Algorithm for Nonconvex Unconstrained Optimization Problems [J].
Deng, Songhai ;
Wan, Zhong ;
Chen, Xiaohong .
JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2013, 157 (03) :820-842
[10]   Benchmarking optimization software with performance profiles [J].
Dolan, ED ;
Moré, JJ .
MATHEMATICAL PROGRAMMING, 2002, 91 (02) :201-213