Estimation of positive definite M-matrices and structure learning for attractive Gaussian Markov random fields

被引:72
作者
Slawski, Martin [1 ]
Hein, Matthias [1 ]
机构
[1] Univ Saarland, Dept Comp Sci, D-66123 Saarbrucken, Germany
关键词
l(1)-regularization; Log-determinant divergence minimization; Gaussian Markov random fields; Graphical model selection; High-dimensional statistical inference; M-matrices; Partial correlations; Precision matrix estimation; Sign constraints; DIMENSIONAL COVARIANCE ESTIMATION; MAXIMUM-LIKELIHOOD-ESTIMATION; MODEL SELECTION; INEQUALITIES; GRAPHS;
D O I
10.1016/j.laa.2014.04.020
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
Consider a random vector with finite second moments. If its precision matrix is an M-matrix, then all partial correlations are non-negative. If that random vector is additionally Gaussian, the corresponding Markov random field (GMRF) is called attractive. We study estimation of M-matrices taking the role of inverse second moment or precision matrices using sign-constrained log-determinant divergence minimization. We also treat the high-dimensional case with the number of variables exceeding the sample size. The additional sign-constraints turn out to greatly simplify the estimation problem: we provide evidence that explicit regularization is no longer required. To solve the resulting convex optimization problem, we propose an algorithm based on block coordinate descent, in which each sub-problem can be recast as non-negative least squares problem. Illustrations on both simulated and real world data are provided. (C) 2014 Elsevier Inc. All rights reserved.
引用
收藏
页码:145 / 179
页数:35
相关论文
共 47 条
  • [1] Anandkumar A, 2012, J MACH LEARN RES, V13, P2293
  • [2] [Anonymous], 1999, Athena scientific Belmont
  • [3] [Anonymous], 1937, Comment. Math. Helv, DOI DOI 10.1007/BF01214284
  • [4] [Anonymous], P 33 ANN COGN SCI C
  • [5] [Anonymous], 2011, CVX MATLAB SOFTWARE
  • [6] [Anonymous], 1980, Multivariate Analysis
  • [7] Banerjee O, 2008, J MACH LEARN RES, V9, P485
  • [8] Berman A., 2003, Completely positive matrices
  • [9] Berman A., 1994, CLASSICS APPL MATH, DOI DOI 10.1137/1.9781611971262
  • [10] BOLVIKEN E, 1982, SCAND J STAT, V9, P49