New line search methods for unconstrained optimization

被引:32
作者
Yuan, Gonglin [1 ]
Wei, Zengxin [1 ]
机构
[1] Guangxi Univ, Coll Math & Informat Sci, Nanning 530004, Guangxi, Peoples R China
基金
中国国家自然科学基金;
关键词
Unconstrained optimization; Line search method; Global convergence; R-linear convergence; Probability; QUASI-NEWTON METHODS; TRUST REGION ALGORITHM; CONVERGENCE PROPERTIES; CONSTRAINED MINIMIZATION; SUPERLINEAR CONVERGENCE; REGRESSION; BARZILAI;
D O I
10.1016/j.jkss.2008.05.004
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
It is well known that the search direction plays a main role in the line search method. In this paper, we propose a new search direction together with the Wolfe line search technique and one nonmonotone line search technique for solving unconstrained optimization problems. The given methods possess sufficiently descent property without carrying out any line search rule. The convergent results are established under suitable conditions. For numerical results, analysis of one probability shows that the new methods are more effective, robust, and stable, than other similar methods. Numerical results of two statistical problems also show that the presented methods are more interesting than other normal methods. (C) 2008 The Korean Statistical Society. Published by Elsevier B.V. All rights reserved.
引用
收藏
页码:29 / 39
页数:11
相关论文
共 50 条
[21]   MODIFIED LIMITED MEMORY BFGS METHOD WITH NONMONOTONE LINE SEARCH FOR UNCONSTRAINED OPTIMIZATION [J].
Yuan, Gonglin ;
Wei, Zengxin ;
Wu, Yanlin .
JOURNAL OF THE KOREAN MATHEMATICAL SOCIETY, 2010, 47 (04) :767-788
[22]   A cubic regularization algorithm for unconstrained optimization using line search and nonmonotone techniques [J].
Bianconcini, Tommaso ;
Sciandrone, Marco .
OPTIMIZATION METHODS & SOFTWARE, 2016, 31 (05) :1008-1035
[23]   A class of nonmonotone Armijo-type line search method for unconstrained optimization [J].
Ahookhosh, Masoud ;
Amini, Keyvan ;
Bahrami, Somayeh .
OPTIMIZATION, 2012, 61 (04) :387-404
[24]   A regularized Newton method without line search for unconstrained optimization [J].
Ueda, Kenji ;
Yamashita, Nobuo .
COMPUTATIONAL OPTIMIZATION AND APPLICATIONS, 2014, 59 (1-2) :321-351
[25]   EFFICIENT LINE SEARCH ALGORITHM FOR UNCONSTRAINED OPTIMIZATION [J].
POTRA, FA ;
SHI, Y .
JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 1995, 85 (03) :677-704
[26]   A Non-monotone Line Search Algorithm for Unconstrained Optimization [J].
Sheng-Long Hu ;
Zheng-Hai Huang ;
Nan Lu .
Journal of Scientific Computing, 2010, 42
[27]   A nonmonotone line search technique and its application to unconstrained optimization [J].
Zhang, HC ;
Hager, WW .
SIAM JOURNAL ON OPTIMIZATION, 2004, 14 (04) :1043-1056
[28]   A nonmonotone line search method and its convergence for unconstrained optimization [J].
Cui, Zhaocheng ;
Yang, Zhenqi .
JOURNAL OF VIBRATION AND CONTROL, 2013, 19 (04) :517-520
[29]   A regularized Newton method without line search for unconstrained optimization [J].
Kenji Ueda ;
Nobuo Yamashita .
Computational Optimization and Applications, 2014, 59 :321-351
[30]   New quasi-Newton methods for unconstrained optimization problems [J].
Wei, Zengxin ;
Li, Guoyin ;
Qi, Liqun .
APPLIED MATHEMATICS AND COMPUTATION, 2006, 175 (02) :1156-1188