A new subspace minimization conjugate gradient method based on tensor model for unconstrained optimization

被引:12
作者
Wang, Ting [1 ]
Liu, Zexian [1 ,2 ]
Liu, Hongwei [1 ]
机构
[1] Xidian Univ, Sch Math & Stat, Xian 710126, Shaanxi, Peoples R China
[2] Hezhou Univ, Sch Math & Comp Sci, Hezhou, Peoples R China
基金
中国国家自然科学基金;
关键词
Conjugate gradient method; tensor model; subspace technique; non-monotone line search; unconstrained optimizaiton; SOFTWARE PACKAGE; ALGORITHM;
D O I
10.1080/00207160.2018.1542136
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
A new subspace minimization conjugate gradient method based on tensor model is proposed and analysed. If the objective function is close to a quadratic, we construct a quadratic approximation model in a two-dimensional subspace to generate the search direction; otherwise, we construct a tensor model. It is remarkable that the search direction satisfies the sufficient descent property. We prove the global convergence of the proposed method under mild assumptions. Numerical comparisons are given with well-known CGOPT and CG_DESCENT and show that the proposed algorithm is very promising.
引用
收藏
页码:1924 / 1942
页数:19
相关论文
共 36 条
[1]  
Andrei N., 2008, Adv. Model. Optim, V10, P147
[2]   An accelerated subspace minimization three-term conjugate gradient algorithm for unconstrained optimization [J].
Andrei, Neculai .
NUMERICAL ALGORITHMS, 2014, 65 (04) :859-874
[3]   2-POINT STEP SIZE GRADIENT METHODS [J].
BARZILAI, J ;
BORWEIN, JM .
IMA JOURNAL OF NUMERICAL ANALYSIS, 1988, 8 (01) :141-148
[4]   Tensor methods for large, sparse unconstrained optimization [J].
Bouaricha, A .
SIAM JOURNAL ON OPTIMIZATION, 1997, 7 (03) :732-756
[5]   Algorithm 765: STENMIN: A software package for large, sparse unconstrained optimization using tensor methods [J].
Bouaricha, A .
ACM TRANSACTIONS ON MATHEMATICAL SOFTWARE, 1997, 23 (01) :81-90
[6]   TENSOR METHODS FOR LARGE, SPARSE NONLINEAR LEAST SQUARES PROBLEMS [J].
Bouaricha, Ali ;
Schnabel, Robert B. .
SIAM JOURNAL ON SCIENTIFIC COMPUTING, 1999, 21 (04) :1199-1221
[7]   ALGORITHM-739 - A SOFTWARE PACKAGE FOR UNCONSTRAINED OPTIMIZATION USING TENSOR METHODS [J].
CHOW, T ;
ESKOW, E ;
SCHNABEL, R .
ACM TRANSACTIONS ON MATHEMATICAL SOFTWARE, 1994, 20 (04) :518-530
[8]   New conjugacy conditions and related nonlinear conjugate gradient methods [J].
Dai, YH ;
Liao, LZ .
APPLIED MATHEMATICS AND OPTIMIZATION, 2001, 43 (01) :87-101
[9]   A nonlinear conjugate gradient method with a strong global convergence property [J].
Dai, YH ;
Yuan, Y .
SIAM JOURNAL ON OPTIMIZATION, 1999, 10 (01) :177-182
[10]   A NONLINEAR CONJUGATE GRADIENT ALGORITHM WITH AN OPTIMAL PROPERTY AND AN IMPROVED WOLFE LINE SEARCH [J].
Dai, Yu-Hong ;
Kou, Cai-Xia .
SIAM JOURNAL ON OPTIMIZATION, 2013, 23 (01) :296-320