A diagonal quasi-Newton updating method based on minimizing the measure function of Byrd and Nocedal for unconstrained optimization

被引:9
作者
Andrei, Neculai [1 ,2 ]
机构
[1] Ctr Adv Modeling & Optimizat, Res Inst Informat, 8-10 Averescu Ave, Bucharest 1, Romania
[2] Acad Romanian Scientists, 54 Splaiul Independentei, Bucharest 5, Romania
关键词
Unconstrained optimization; weak secant; diagonal quasi-Newton update; measure function of Byrd and Nocedal; numerical comparisons; CONJUGATE-GRADIENT ALGORITHM; CONVERGENCE CONDITIONS;
D O I
10.1080/02331934.2018.1482298
中图分类号
C93 [管理学]; O22 [运筹学];
学科分类号
070105 ; 12 ; 1201 ; 1202 ; 120202 ;
摘要
A new quasi-Newton method with a diagonal updating matrix is suggested, where the diagonal elements are determined by minimizing the measure function of Byrd and Nocedal subject to the weak secant equation of Dennis and Wolkowicz. The Lagrange multiplier of this minimization problem is computed by using an adaptive procedure based on the conjugacy condition. The convergence of the algorithm is proved for twice differentiable, convex and bounded below functions using only the trace and the determinant. Using a set of 80 unconstrained optimization test problems and some applications from the MINPACK-2 collection, we have the computational evidence that the algorithm is more efficient and more robust than the steepest-descent, the Barzilai and Borwein algorithm, the Cauchy algorithm with Oren and Luenberger scaling and the classical BFGS algorithms with the Wolfe line search conditions.
引用
收藏
页码:1553 / 1568
页数:16
相关论文
共 36 条
[1]   A new gradient method via quasi-Cauchy relation which guarantees descent [J].
Abu Hassan, Malik ;
Leong, Wah June ;
Farid, Mahboubeh .
JOURNAL OF COMPUTATIONAL AND APPLIED MATHEMATICS, 2009, 230 (01) :300-305
[2]  
Andrei N, 2017, SPRINGER OPTIMIZATIO, V121
[3]  
Andrei N., 2008, ADV MODEL OPTIM, V10, P147, DOI DOI 10.1021/es702781x
[4]   Eigenvalues versus singular values study in conjugate gradient algorithms for large-scale unconstrained optimization [J].
Andrei, Neculai .
OPTIMIZATION METHODS & SOFTWARE, 2017, 32 (03) :534-551
[5]   An adaptive conjugate gradient algorithm for large-scale unconstrained optimization [J].
Andrei, Neculai .
JOURNAL OF COMPUTATIONAL AND APPLIED MATHEMATICS, 2016, 292 :83-91
[6]   A new three-term conjugate gradient algorithm for unconstrained optimization [J].
Andrei, Neculai .
NUMERICAL ALGORITHMS, 2015, 68 (02) :305-321
[7]  
[Anonymous], 1959, Tech. Rep. ANL-5990
[8]  
[Anonymous], 1995, NONLINEAR PROGRAMMIN
[9]  
Averick B.M., 1992, MCSP1530692 MATH COM
[10]   A modified scaling parameter for the memoryless BFGS updating formula [J].
Babaie-Kafaki, Saman .
NUMERICAL ALGORITHMS, 2016, 72 (02) :425-433