Optimal Estimation of Gaussian DAG Models

被引:0
|
作者
Gao, Ming [1 ]
Tai, Wai Ming [1 ]
Aragam, Bryon [1 ]
机构
[1] Univ Chicago, Chicago, IL 60637 USA
关键词
INFORMATION-THEORETIC LIMITS; MAXIMUM-LIKELIHOOD; VARIABLE SELECTION; CAUSAL DISCOVERY; SPARSITY RECOVERY; BAYESIAN NETWORK; GRAPHS;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We study the optimal sample complexity of learning a Gaussian directed acyclic graph (DAG) from observational data. Our main results establish the minimax optimal sample complexity for learning the structure of a linear Gaussian DAG model in two settings of interest: 1) Under equal variances without knowledge of the true ordering, and 2) For general linear models given knowledge of the ordering. In both cases the sample complexity is n asymptotic to q log(d/q), where q is the maximum number of parents and d is the number of nodes. We further make comparisons with the classical problem of learning (undirected) Gaussian graphical models, showing that under the equal variance assumption, these two problems share the same optimal sample complexity. In other words, at least for Gaussian models with equal error variances, learning a directed graphical model is statistically no more difficult than learning an undirected graphical model. Our results also extend to more general identification assumptions as well as subgaussian errors.
引用
收藏
页数:20
相关论文
共 50 条
  • [1] Optimal Parameter Estimation Of Gaussian Linear Discrete Models In The Frequency Domain
    Chernikova, Oksana S.
    Anisimova, Kseniia N.
    2016 11TH INTERNATIONAL FORUM ON STRATEGIC TECHNOLOGY (IFOST), PTS 1 AND 2, 2016,
  • [2] Pair-copula constructions for non-Gaussian DAG models
    Bauer, Alexander
    Czado, Claudia
    Klein, Thomas
    CANADIAN JOURNAL OF STATISTICS-REVUE CANADIENNE DE STATISTIQUE, 2012, 40 (01): : 86 - 109
  • [3] Optimal Estimation of Gaussian (Poly)trees
    Wang, Yuhao
    Gao, Ming
    Tai, Wai Ming
    Aragam, Bryon
    Bhattacharyya, Arnab
    INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND STATISTICS, VOL 238, 2024, 238
  • [4] Tractable and Near-Optimal Adversarial Algorithms for Robust Estimation in Contaminated Gaussian Models
    Wang, Ziyue
    Tan, Zhiqiang
    JOURNAL OF MACHINE LEARNING RESEARCH, 2023, 24
  • [5] Optimal Transport for Gaussian Mixture Models
    Chen, Yongxin
    Georgiou, Tryphon T.
    Tannenbaum, Allen
    IEEE ACCESS, 2019, 7 : 6269 - 6278
  • [6] Estimation of optimal portfolio compositions for Gaussian returns
    Bodnar, Taras
    Schmid, Wolfgang
    STATISTICS & RISK MODELING, 2008, 26 (03) : 179 - 201
  • [7] Optimal estimation of families of models
    Rissanen, J.
    2008 IEEE INFORMATION THEORY WORKSHOP, 2008, : 258 - 258
  • [8] Optimal estimation and Cramer-Rao bounds for partial non-gaussian state space models
    Bergman, N
    Doucet, A
    Gordon, N
    ANNALS OF THE INSTITUTE OF STATISTICAL MATHEMATICS, 2001, 53 (01) : 97 - 112
  • [9] Pose estimation based on Gaussian error models
    Chai, XJ
    Shan, SG
    Qing, LY
    Gao, W
    ADVANCES IN BIOMETRICS, PROCEEDINGS, 2006, 3832 : 136 - 143
  • [10] QUANTIZATION WITH ADAPTATION - ESTIMATION OF GAUSSIAN LINEAR MODELS
    Gerencser, Laszlo
    Kmecs, Ildiko
    Torma, Balazs
    COMMUNICATIONS IN INFORMATION AND SYSTEMS, 2008, 8 (03) : 223 - 244