Two classes of multisecant methods for nonlinear acceleration

被引:222
作者
Fang, Haw-ren [1 ]
Saad, Yousef [1 ]
机构
[1] Univ Minnesota, Dept Comp Sci & Engn, Minneapolis, MN 55455 USA
基金
美国国家科学基金会;
关键词
quasi-Newton methods; fixed point problems; self-consistent field (SCF) iteration; Broyden's methods; Anderson mixing; QUASI-NEWTON METHODS; MATRIX FACTORIZATIONS; SECANT METHOD; EQUATIONS; CONVERGENCE; SYSTEMS; ALGORITHM; PARSEC;
D O I
10.1002/nla.617
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
Many applications in science and engineering lead to models that require solving large-scale fixed point problems, or equivalently, systems of nonlinear equations. Several successful techniques for handling such problems are based on quasi-Newton methods that implicitly update the approximate Jacobian or inverse Jacobian to satisfy a certain secant condition. We present two classes of multisecant methods which allow to take into account a variable number of secant equations at each iteration. The first is the Broyden-like class, of which Broyden's family is a subclass, and Anderson mixing is a particular member. The second class is that of the nonlinear Eirola-Nevanlinna-type methods. This work was motivated by a problem in electronic structure calculations, whereby a fixed point iteration, known as the self-consistent field (SCF) iteration, is accelerated by various strategies termed 'mixing'. Copyright (C) 2008 John Wiley & Sons, Ltd.
引用
收藏
页码:197 / 221
页数:25
相关论文
共 29 条
[1]   ITERATIVE PROCEDURES FOR NONLINEAR INTEGRAL EQUATIONS [J].
ANDERSON, DG .
JOURNAL OF THE ACM, 1965, 12 (04) :547-&
[2]   AN ALGORITHM FOR SOLVING NON-LINEAR EQUATIONS BASED ON THE SECANT METHOD [J].
BARNES, JGP .
COMPUTER JOURNAL, 1965, 8 (01) :66-72
[3]   Solving noisy, large-scale fixed-point problems and systems of nonlinear equations [J].
Bierlaire, M ;
Crittin, F .
TRANSPORTATION SCIENCE, 2006, 40 (01) :44-63
[4]  
BJORK A, 1996, NUMERICAL METHODS LE
[5]   CONVERGENCE THEORY OF NONLINEAR NEWTON-KRYLOV ALGORITHMS [J].
BROWN, PN ;
SAAD, Y .
SIAM JOURNAL ON OPTIMIZATION, 1994, 4 (02) :297-330
[6]   HYBRID KRYLOV METHODS FOR NONLINEAR-SYSTEMS OF EQUATIONS [J].
BROWN, PN ;
SAAD, Y .
SIAM JOURNAL ON SCIENTIFIC AND STATISTICAL COMPUTING, 1990, 11 (03) :450-481
[7]  
Broyden C. G., 1965, MATH COMPUTATION
[8]  
Chelikowsky J. R., 2003, Handb. Numer. Anal, V10, P613, DOI [10.1016/s1570-8659(03)10010-5, DOI 10.1016/S1570-8659(03)10010-5]
[9]  
Chelikowsky JamesR., 1996, QUANTUM THEORY REAL, V348
[10]   DIRECT SECANT UPDATES OF MATRIX FACTORIZATIONS [J].
DENNIS, JE ;
MARWIL, ES .
MATHEMATICS OF COMPUTATION, 1982, 38 (158) :459-474