Tree-based Node Aggregation in Sparse Graphical Models

被引:0
作者
Wilms, Ines [1 ]
Bien, Jacob [2 ]
机构
[1] Maastricht Univ, Dept Quantitat Econ, Maastricht, Netherlands
[2] Univ Southern Calif, Marshall Sch Business, Dept Data Sci & Operat, Los Angeles, CA USA
关键词
aggregation; graphical model; high-dimensionality; regularization; sparsity; COVARIANCE ESTIMATION; SELECTION; INVERSE;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
High-dimensional graphical models are often estimated using regularization that is aimed at reducing the number of edges in a network. In this work, we show how even simpler networks can be produced by aggregating the nodes of the graphical model. We develop a new convex regularized method, called the tree-aggregated graphical lasso or tag-lasso, that estimates graphical models that are both edge-sparse and node-aggregated. The aggrega-tion is performed in a data-driven fashion by leveraging side information in the form of a tree that encodes node similarity and facilitates the interpretation of the resulting aggre-gated nodes. We provide an efficient implementation of the tag-lasso by using the locally adaptive alternating direction method of multipliers and illustrate our proposal's practical advantages in simulation and in applications in finance and biology.
引用
收藏
页数:36
相关论文
共 36 条
  • [1] AITCHISON J, 1982, J ROY STAT SOC B, V44, P139
  • [2] Banerjee O, 2008, J MACH LEARN RES, V9, P485
  • [3] Least squares after model selection in high-dimensional sparse models
    Belloni, Alexandre
    Chernozhukov, Victor
    [J]. BERNOULLI, 2013, 19 (02) : 521 - 547
  • [4] Bien J., 2020, bioRxiv
  • [5] Bien J, 2016, Arxiv, DOI arXiv:1607.00021
  • [6] Distributed optimization and statistical learning via the alternating direction method of multipliers
    Boyd S.
    Parikh N.
    Chu E.
    Peleato B.
    Eckstein J.
    [J]. Foundations and Trends in Machine Learning, 2010, 3 (01): : 1 - 122
  • [7] Community Detection in Partial Correlation Network Models
    Brownlees, Christian
    Gudmundsson, Gudmundur Stefan
    Lugosi, Gabor
    [J]. JOURNAL OF BUSINESS & ECONOMIC STATISTICS, 2022, 40 (01) : 216 - 226
  • [8] Bunea F, 2020, ANN STAT, V48, P111, DOI [10.1214/18-AOS1794, 10.1214/18-aos1794]
  • [9] ESTIMATING SPARSE PRECISION MATRIX: OPTIMAL RATES OF CONVERGENCE AND ADAPTIVE ESTIMATION
    Cai, T. Tony
    Liu, Weidong
    Zhou, Harrison H.
    [J]. ANNALS OF STATISTICS, 2016, 44 (02) : 455 - 488
  • [10] A Constrained l1 Minimization Approach to Sparse Precision Matrix Estimation
    Cai, Tony
    Liu, Weidong
    Luo, Xi
    [J]. JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2011, 106 (494) : 594 - 607