A hybridization of the Polak-RibiSre-Polyak and Fletcher-Reeves conjugate gradient methods

被引:20
作者
Babaie-Kafaki, Saman [1 ]
Ghanbari, Reza [2 ]
机构
[1] Semnan Univ, Dept Math, Fac Math Stat & Comp Sci, Semnan, Iran
[2] Ferdowsi Univ Mashhad, Fac Math Sci, Mashhad, Iran
关键词
Unconstrained optimization; Large-scale optimization; Conjugate gradient method; Global convergence; SUFFICIENT DESCENT PROPERTY; GLOBAL CONVERGENCE; ALGORITHM; MINIMIZATION;
D O I
10.1007/s11075-014-9856-6
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
In order to achieve a theoretically effective and numerically efficient method for solving large-scale unconstrained optimization problems, a hybridization of the Fletcher-Reeves and Polak-RibiSre-Polyak conjugate gradient methods is proposed. In the method, the hybridization parameter is computed such that the generated search directions approach to the search directions of the efficient three-term conjugate gradient method proposed by Zhang et al., to the extent possible. Under proper conditions, global convergence of the method is established without convexity assumption on the objective function. The method is numerically compared with the three-term conjugate gradient method proposed by Zhang et al. and a modified version of the Polak-RibiSre-Polyak method suggested by Gilbert and Nocedal. Comparative testing results demonstrating the efficiency of the proposed method are reported.
引用
收藏
页码:481 / 495
页数:15
相关论文
共 27 条
[1]   DESCENT PROPERTY AND GLOBAL CONVERGENCE OF THE FLETCHER REEVES METHOD WITH INEXACT LINE SEARCH [J].
ALBAALI, M .
IMA JOURNAL OF NUMERICAL ANALYSIS, 1985, 5 (01) :121-124
[2]   Hybrid Conjugate Gradient Algorithm for Unconstrained Optimization [J].
Andrei, N. .
JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2009, 141 (02) :249-264
[3]   A modified Polak-Ribiere-Polyak conjugate gradient algorithm for unconstrained optimization [J].
Andrei, Neculai .
OPTIMIZATION, 2011, 60 (12) :1457-1471
[4]   Two Modified Hybrid Conjugate Gradient Methods Based on a Hybrid Secant Equation [J].
Babaie-Kafaki, Saman ;
Mahdavi-Amiri, Nezam .
MATHEMATICAL MODELLING AND ANALYSIS, 2013, 18 (01) :32-52
[5]   A Quadratic Hybridization of Polak-RibiSre-Polyak and Fletcher-Reeves Conjugate Gradient Methods [J].
Babaie-Kafaki, Saman .
JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2012, 154 (03) :916-932
[6]   Two new conjugate gradient methods based on modified secant equations [J].
Babaie-Kafaki, Saman ;
Ghanbari, Reza ;
Mandavi-Amiri, Nezam .
JOURNAL OF COMPUTATIONAL AND APPLIED MATHEMATICS, 2010, 234 (05) :1374-1386
[7]  
Dai YH, 1997, Analysis of conjugate gradient methods
[8]   A NONLINEAR CONJUGATE GRADIENT ALGORITHM WITH AN OPTIMAL PROPERTY AND AN IMPROVED WOLFE LINE SEARCH [J].
Dai, Yu-Hong ;
Kou, Cai-Xia .
SIAM JOURNAL ON OPTIMIZATION, 2013, 23 (01) :296-320
[9]   Benchmarking optimization software with performance profiles [J].
Dolan, ED ;
Moré, JJ .
MATHEMATICAL PROGRAMMING, 2002, 91 (02) :201-213
[10]   FUNCTION MINIMIZATION BY CONJUGATE GRADIENTS [J].
FLETCHER, R ;
REEVES, CM .
COMPUTER JOURNAL, 1964, 7 (02) :149-&