Compact representation of the full Broyden class of quasi-Newton updates

被引:6
作者
DeGuchy, Omar [1 ]
Erway, Jennifer B. [2 ]
Marcia, Roummel F. [1 ]
机构
[1] Univ Calif, Appl Math, Merced, CA 95343 USA
[2] Wake Forest Univ, Dept Math, Winston Salem, NC 27106 USA
基金
美国国家科学基金会;
关键词
condition numbers; eigenvalues; inverses; limited-memory quasi-Newton methods; quasi-Newton matrices; spectral decomposition; MATRICES;
D O I
10.1002/nla.2186
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
In this paper, we present the compact representation for matrices belonging to the Broyden class of quasi-Newton updates, where each update may be either rank one or rank two. This work extends previous results solely for the restricted Broyden class of rank-two updates. In this article, it is not assumed that the same Broyden update is used in each iteration; rather, different members of the Broyden class may be used in each iteration. Numerical experiments suggest that a practical implementation of the compact representation is able to accurately represent matrices belonging to the Broyden class of updates. Furthermore, we demonstrate how to compute the compact representation for the inverse of these matrices and a practical algorithm for solving linear systems with members of the Broyden class of updates. We demonstrate through numerical experiments that the proposed linear solver is able to efficiently solve linear systems with members of the Broyden class of matrices with high accuracy. As an immediate consequence of this work, it is now possible to efficiently compute the eigenvalues of any limited-memory member of the Broyden class of matrices, allowing for the computation of condition numbers and the ability to perform sensitivity analysis.
引用
收藏
页数:15
相关论文
共 17 条
[1]  
Adhikari L, 2017, P SPIE
[2]  
Adhikari L, 2016, PROCEEDINGS OF 2016 INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY AND ITS APPLICATIONS (ISITA 2016), P275
[3]  
Brust J, 2016, SHAPE CHANGING UNPUB
[4]  
Brust J, 2016, COMPUT OPTIM APPL, V66, P1
[5]   On efficiently combining limited-memory and trust-region techniques [J].
Burdakov O. ;
Gong L. ;
Zikrin S. ;
Yuan Y.-X. .
Mathematical Programming Computation, 2017, 9 (01) :101-134
[6]  
Burke J.V., 1996, Limited Memory BFGS Updating
[7]   REPRESENTATIONS OF QUASI-NEWTON MATRICES AND THEIR USE IN LIMITED MEMORY METHODS [J].
BYRD, RH ;
NOCEDAL, J ;
SCHNABEL, RB .
MATHEMATICAL PROGRAMMING, 1994, 63 (02) :129-156
[8]   ON THE BEHAVIOR OF BROYDENS CLASS OF QUASI-NEWTON METHODS [J].
Byrd, Richard H. ;
Liu, Dong C. ;
Nocedal, Jorge .
SIAM JOURNAL ON OPTIMIZATION, 1992, 2 (04) :533-557
[9]   QUASI-NEWTON METHODS, MOTIVATION AND THEORY [J].
DENNIS, JE ;
MORE, JJ .
SIAM REVIEW, 1977, 19 (01) :46-89
[10]   On solving large-scale limited-memory quasi-Newton equations [J].
Erway, Jennifer B. ;
Marcia, Roummel F. .
LINEAR ALGEBRA AND ITS APPLICATIONS, 2017, 515 :196-225