NEW HYBRID CONJUGATE GRADIENT METHOD AS A CONVEX COMBINATION OF LS AND FR METHODS

被引:35
|
作者
Djordjevic, Snezana S. [1 ]
机构
[1] Univ Nis, Fac Technol, Leskovac 16000, Serbia
关键词
hybrid conjugate gradient method; convex combination; Dai-Liao conjugacy condition; Newton direction; GLOBAL CONVERGENCE; UNCONSTRAINED OPTIMIZATION; HESTENES-STIEFEL; ALGORITHM; DESCENT;
D O I
10.1007/s10473-019-0117-6
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
In this paper, we present a new hybrid conjugate gradient algorithm for unconstrained optimization. This method is a convex combination of Liu-Storey conjugate gradient method and Fletcher-Reeves conjugate gradient method. We also prove that the search direction of any hybrid conjugate gradient method, which is a convex combination of two conjugate gradient methods, satisfies the famous D-L conjugacy condition and in the same time accords with the Newton direction with the suitable condition. Furthermore, this property doesn't depend on any line search. Next, we also prove that, moduling the value of the parameter t, the Newton direction condition is equivalent to Dai-Liao conjugacy condition. The strong Wolfe line search conditions are used. The global convergence of this new method is proved. Numerical comparisons show that the present hybrid conjugate gradient algorithm is the efficient one.
引用
收藏
页码:214 / 228
页数:15
相关论文
共 50 条
  • [21] Two families of hybrid conjugate gradient methods with restart procedures and their applications
    Jiang, Xianzhen
    Yang, Huihui
    Jian, Jinbao
    Wu, Xiaodi
    OPTIMIZATION METHODS & SOFTWARE, 2023, 38 (05) : 947 - 974
  • [22] A new family of hybrid conjugate gradient method for unconstrained optimization and its application to regression analysis
    Ben Hanachi, Sabrina
    Sellami, Badreddine
    Belloufi, Mohammed
    RAIRO-OPERATIONS RESEARCH, 2024, 58 (01) : 613 - 627
  • [23] A New Hybrid Three-Term LS-CD Conjugate Gradient In Solving Unconstrained Optimization Problems
    Ishak, M. A. I.
    Marjugi, S. M.
    MALAYSIAN JOURNAL OF MATHEMATICAL SCIENCES, 2024, 18 (01): : 167 - 184
  • [24] A hybrid conjugate gradient method based on a quadratic relaxation of the Dai-Yuan hybrid conjugate gradient parameter
    Babaie-Kafaki, Saman
    OPTIMIZATION, 2013, 62 (07) : 929 - 941
  • [25] Conjugate gradient type methods for the nondifferentiable convex minimization
    Li, Qiong
    OPTIMIZATION LETTERS, 2013, 7 (03) : 533 - 545
  • [26] New Hybrid Conjugate Gradient and Broyden–Fletcher–Goldfarb–Shanno Conjugate Gradient Methods
    Predrag S. Stanimirović
    Branislav Ivanov
    Snežana Djordjević
    Ivona Brajević
    Journal of Optimization Theory and Applications, 2018, 178 : 860 - 884
  • [27] A NEW HYBRID CG METHOD AS CONVEX COMBINATION
    Hallal, Amina
    Belloufi, Mohammed
    Sellami, Badreddine
    MATHEMATICAL FOUNDATIONS OF COMPUTING, 2024, 7 (04): : 522 - 530
  • [28] A new family of hybrid three-term conjugate gradient methods with applications in image restoration
    Jiang, Xianzhen
    Liao, Wei
    Yin, Jianghua
    Jian, Jinbao
    NUMERICAL ALGORITHMS, 2022, 91 (01) : 161 - 191
  • [29] Two Modified Hybrid Conjugate Gradient Methods Based on a Hybrid Secant Equation
    Babaie-Kafaki, Saman
    Mahdavi-Amiri, Nezam
    MATHEMATICAL MODELLING AND ANALYSIS, 2013, 18 (01) : 32 - 52
  • [30] A new family of conjugate gradient methods
    Shi, Zhen-Jun
    Guo, Jinhua
    JOURNAL OF COMPUTATIONAL AND APPLIED MATHEMATICS, 2009, 224 (01) : 444 - 457