A new regularized quasi-Newton method for unconstrained optimization

被引:6
作者
Zhang, Hao [1 ,2 ]
Ni, Qin [1 ]
机构
[1] Nanjing Univ Aeronaut & Astronaut, Coll Sci, Nanjing 210016, Jiangsu, Peoples R China
[2] Nanjing Agr Univ, Coll Engn, Nanjing 210031, Jiangsu, Peoples R China
关键词
Unconstrained optimization; Regularized quasi-Newton method; Non-monotone line search; LIMITED-MEMORY; LINE SEARCH; ALGORITHM; MATRICES;
D O I
10.1007/s11590-018-1236-z
中图分类号
C93 [管理学]; O22 [运筹学];
学科分类号
070105 ; 12 ; 1201 ; 1202 ; 120202 ;
摘要
In this paper, we propose a new regularized quasi-Newton method for unconstrained optimization. At each iteration, a regularized quasi-Newton equation is solved to obtain the search direction. The step size is determined by a non-monotone Armijo backtracking line search. An adaptive regularized parameter, which is updated according to the step size of the line search, is employed to compute the next search direction. The presented method is proved to be globally convergent. Numerical experiments show that the proposed method is effective for unconstrained optimizations and outperforms the existing regularized Newton method.
引用
收藏
页码:1639 / 1658
页数:20
相关论文
共 16 条
[1]   On efficiently combining limited-memory and trust-region techniques [J].
Burdakov O. ;
Gong L. ;
Zikrin S. ;
Yuan Y.-X. .
Mathematical Programming Computation, 2017, 9 (01) :101-134
[2]   REPRESENTATIONS OF QUASI-NEWTON MATRICES AND THEIR USE IN LIMITED MEMORY METHODS [J].
BYRD, RH ;
NOCEDAL, J ;
SCHNABEL, RB .
MATHEMATICAL PROGRAMMING, 1994, 63 (02) :129-156
[3]   NONMONOTONIC TRUST REGION ALGORITHM [J].
DENG, NY ;
XIAO, Y ;
ZHOU, FJ .
JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 1993, 76 (02) :259-285
[4]   Benchmarking optimization software with performance profiles [J].
Dolan, ED ;
Moré, JJ .
MATHEMATICAL PROGRAMMING, 2002, 91 (02) :201-213
[5]   ON EFFICIENTLY COMPUTING THE EIGENVALUES OF LIMITED-MEMORY QUASI-NEWTON MATRICES [J].
Erway, Jennifer B. ;
Marcia, Roummel F. .
SIAM JOURNAL ON MATRIX ANALYSIS AND APPLICATIONS, 2015, 36 (03) :1338-1359
[6]   CUTEst: a Constrained and Unconstrained Testing Environment with safe threads for mathematical optimization [J].
Gould, Nicholas I. M. ;
Orban, Dominique ;
Toint, Philippe L. .
COMPUTATIONAL OPTIMIZATION AND APPLICATIONS, 2015, 60 (03) :545-557
[7]   A NONMONOTONE LINE SEARCH TECHNIQUE FOR NEWTON METHOD [J].
GRIPPO, L ;
LAMPARIELLO, F ;
LUCIDI, S .
SIAM JOURNAL ON NUMERICAL ANALYSIS, 1986, 23 (04) :707-716
[8]   Incorporating nonmonotone strategies into the trust region method for unconstrained optimization [J].
Gu, Neng-zhu ;
Mo, Jiang-tao .
COMPUTERS & MATHEMATICS WITH APPLICATIONS, 2008, 55 (09) :2158-2172
[9]   Regularized Newton methods for convex minimization problems with singular solutions [J].
Li, DH ;
Fukushima, M ;
Qi, LQ ;
Yamashita, N .
COMPUTATIONAL OPTIMIZATION AND APPLICATIONS, 2004, 28 (02) :131-147
[10]   Truncated regularized Newton method for convex minimizations [J].
Li, Ying-Jie ;
Li, Dong-Hui .
COMPUTATIONAL OPTIMIZATION AND APPLICATIONS, 2009, 43 (01) :119-131