A new three-term spectral conjugate gradient algorithm with higher numerical performance for solving large scale optimization problems based on Quasi-Newton equation

被引:2
作者
Guo, Jie [1 ]
Wan, Zhong [1 ]
机构
[1] Cent South Univ, Sch Math & Stat, Changsha, Hunan, Peoples R China
基金
中国国家自然科学基金;
关键词
High performance computing; optimization algorithm; conjugate gradient method; convergence analysis; GLOBAL CONVERGENCE; DESCENT;
D O I
10.1142/S1793962321500537
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
A new spectral three-term conjugate gradient algorithm in virtue of the Quasi-Newton equation is developed for solving large-scale unconstrained optimization problems. It is proved that the search directions in this algorithm always satisfy a sufficiently descent condition independent of any line search. Global convergence is established for general objective functions if the strong Wolfe line search is used. Numerical experiments are employed to show its high numerical performance in solving large-scale optimization problems. Particularly, the developed algorithm is implemented to solve the 100 benchmark test problems from CUTE with different sizes from 1000 to 10,000, in comparison with some similar ones in the literature. The numerical results demonstrate that our algorithm outperforms the state-of-the-art ones in terms of less CPU time, less number of iteration or less number of function evaluation.
引用
收藏
页数:14
相关论文
共 29 条
[11]   A spectral three-term Hestenes-Stiefel conjugate gradient method [J].
Faramarzi, Parvaneh ;
Amini, Keyvan .
4OR-A QUARTERLY JOURNAL OF OPERATIONS RESEARCH, 2021, 19 (01) :71-92
[12]   GLOBAL CONVERGENCE PROPERTIES OF CONJUGATE GRADIENT METHODS FOR OPTIMIZATION [J].
Gilbert, Jean Charles ;
Nocedal, Jorge .
SIAM JOURNAL ON OPTIMIZATION, 1992, 2 (01) :21-42
[13]   A Modified Spectral PRP Conjugate Gradient Projection Method for Solving Large-Scale Monotone Equations and Its Application in Compressed Sensing [J].
Guo, Jie ;
Wan, Zhong .
MATHEMATICAL PROBLEMS IN ENGINEERING, 2019, 2019
[14]   A new conjugate gradient method with guaranteed descent and an efficient line search [J].
Hager, WW ;
Zhang, HC .
SIAM JOURNAL ON OPTIMIZATION, 2005, 16 (01) :170-192
[15]   GLOBAL CONVERGENCE RESULT FOR CONJUGATE-GRADIENT METHODS [J].
HU, YF ;
STOREY, C .
JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 1991, 71 (02) :399-405
[16]   An extended nonmonotone line search technique for large-scale unconstrained optimization [J].
Huang, Shuai ;
Wan, Zhong ;
Zhang, Jing .
JOURNAL OF COMPUTATIONAL AND APPLIED MATHEMATICS, 2018, 330 :586-604
[17]   NEW ADAPTIVE BARZILAI-BORWEIN STEP SIZE AND ITS APPLICATION IN SOLVING LARGE-SCALE OPTIMIZATION PROBLEMS [J].
Li, Ting ;
Wan, Zhong .
ANZIAM JOURNAL, 2019, 61 (01) :76-98
[18]   A new conjugate gradient method based on Quasi-Newton equation for unconstrained optimization [J].
Li, Xiangli ;
Shi, Juanjuan ;
Dong, Xiaoliang ;
Yu, Jianglan .
JOURNAL OF COMPUTATIONAL AND APPLIED MATHEMATICS, 2019, 350 :372-379
[19]   Sustainable recycle network of heterogeneous pharmaceuticals with governmental subsidies and service-levels of third-party logistics by bi-level programming approach [J].
Liu, Wenli ;
Wan, Zhaoman ;
Wan, Zhong ;
Gong, Bing .
JOURNAL OF CLEANER PRODUCTION, 2020, 249
[20]   CONJUGATE DIRECTION ALGORITHM WITHOUT LINE SEARCHES [J].
NAZARETH, L .
JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 1977, 23 (03) :373-387