A randomized algorithm for approximating the log determinant of a symmetric positive definite matrix

被引:33
作者
Boutsidis, Christos
Drineas, Petros [1 ]
Kambadur, Prabhanjan [2 ]
Kontopoulou, Eugenia-Maria [1 ]
Zouzias, Anastasios
机构
[1] Purdue Univ, W Lafayette, IN 47907 USA
[2] Bloomberg LP, New York, NY USA
关键词
Logdeterminant approximation; SPD matrix; Randomized algorithm; Power method; Trace estimation; SPARSE; COMPUTATION;
D O I
10.1016/j.laa.2017.07.004
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
We introduce a novel algorithm for approximating the logarithm of the determinant of a symmetric positive definite (SPD) matrix. The algorithm is randomized and approximates the traces of a small number of matrix powers of a specially constructed matrix, using the method of Avron and Toledo [1]. From a theoretical perspective, we present additive and relative error bounds for our algorithm. Our additive error bound works for any SPD matrix, whereas our relative error bound works for SPD matrices whose eigenvalues lie in the interval (theta(1),1), with 0 < theta(1) < 1; the latter setting was proposed in [16]. From an empirical perspective, we demonstrate that a C++ implementation of our algorithm can approximate the logarithm of the determinant of large matrices very accurately in a matter of seconds. (C) 2017 Elsevier Inc. All rights reserved.
引用
收藏
页码:95 / 117
页数:23
相关论文
共 31 条
[1]  
[Anonymous], 2013, Advances in neural information processing systems
[2]  
[Anonymous], 2004, P 36 ANN ACM S THEOR, DOI [DOI 10.1145/1007352, DOI 10.1145/1007352.1007372]
[3]  
[Anonymous], 2011, SC 11, DOI DOI 10.1145/2063384.2063405
[4]   Randomized Algorithms for Estimating the Trace of an Implicit Symmetric Positive Semi-Definite Matrix [J].
Avron, Haim ;
Toledo, Sivan .
JOURNAL OF THE ACM, 2011, 58 (02)
[5]   Monte Carlo estimates of the log determinant of large sparse matrices [J].
Barry, RP ;
Pace, RK .
LINEAR ALGEBRA AND ITS APPLICATIONS, 1999, 289 (1-3) :41-54
[6]  
Curran Paul F., 2009, IET IR SIGN SYST C I
[7]   First-order methods for sparse covariance selection [J].
D'Aspremont, Alexandre ;
Banerjee, Onureena ;
El Ghaoui, Laurent .
SIAM JOURNAL ON MATRIX ANALYSIS AND APPLICATIONS, 2008, 30 (01) :56-66
[8]   ITERATIVE CALCULATION OF A FEW OF LOWEST EIGENVALUES AND CORRESPONDING EIGENVECTORS OF LARGE REAL-SYMMETRIC MATRICES [J].
DAVIDSON, ER .
JOURNAL OF COMPUTATIONAL PHYSICS, 1975, 17 (01) :87-94
[9]  
Davis TA, 2006, FUND ALGORITHMS, V2, P1, DOI 10.1137/1.9780898718881
[10]   The University of Florida Sparse Matrix Collection [J].
Davis, Timothy A. ;
Hu, Yifan .
ACM TRANSACTIONS ON MATHEMATICAL SOFTWARE, 2011, 38 (01)