Levenberg-Marquardt methods with strong local convergence properties for solving nonlinear equations with convex constraints

被引:267
作者
Kanzow, C
Yamashita, N
Fukushima, T [1 ]
机构
[1] Grad Sch Informat, Dept Appl Math & Phys, Kyoto 6068501, Japan
[2] Univ Wurzburg, Inst Appl Math & Stat, D-97074 Wurzburg, Germany
关键词
constrained equations; Levenberg-Marquardt method; projected gradients; quadratic convergence; error bounds;
D O I
10.1016/j.cam.2004.02.013
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
We consider the problem of finding a solution of a constrained (and not necessarily square) system of equations, i.e., we consider systems of nonlinear equations and want to find a solution that belongs to a certain feasible set. To this end, we present two Levenberg-Marquardt-type algorithms that differ in the way they compute their search directions. The first method solves a strictly convex minimization problem at each iteration, whereas the second one solves only one system of linear equations in each step. Both methods are shown to converge locally quadratically under an error bound assumption that is much weaker than the standard nonsingularity condition. Both methods can be globalized in an easy way. Some numerical results for the second method indicate that the algorithm works quite well in practice. (C) 2004 Elsevier B.V. All rights reserved.
引用
收藏
页码:375 / 397
页数:23
相关论文
共 25 条
  • [1] [Anonymous], NUMERISCHE MATH
  • [2] An affine scaling trust-region approach to bound-constrained nonlinear systems
    Bellavia, S
    Macconi, M
    Morini, B
    [J]. APPLIED NUMERICAL MATHEMATICS, 2003, 44 (03) : 257 - 280
  • [3] BELLAVIA S, IN PRESS COMPUT OPTI
  • [4] Bertsekas DP, 1997, J. Oper. Res. Soc., V48, P334, DOI 10.1057/palgrave.jors.2600425
  • [5] Convergence properties of the inexact Levenberg-Marquardt method under local error bound conditions
    Dan, H
    Yamashita, N
    Fukushima, M
    [J]. OPTIMIZATION METHODS & SOFTWARE, 2002, 17 (04) : 605 - 626
  • [6] Dennis, 1996, NUMERICAL METHODS UN
  • [7] Dirkse S.P., 1995, Optimization Methods and Software, V5, P319, DOI DOI 10.1080/10556789508805619
  • [8] FAN JY, 2001, CONVERGENCE NEW LEVE
  • [9] Floudas C., 1999, Nonconvex Optimization and Its Applications, V33, DOI [DOI 10.1007/978-1-4757-3040-1, 10.1007/ 978-1-4757-3040-1]
  • [10] GABRIEL SA, 1994, LARGE SCALE OPTIMIZATION: STATE OF THE ART, P155