Robust causal structure learning with some hidden variables

被引:20
作者
Frot, Benjamin [1 ]
Nandy, Preetam [2 ]
Maathuis, Marloes H. [1 ]
机构
[1] Eidgenossiche TH, Zurich, Switzerland
[2] Univ Penn, Philadelphia, PA 19104 USA
关键词
Causality; Causal structure learning; Confounding; Directed acyclic graphs; High dimensional consistency; Structured sparsity; DIRECTED ACYCLIC GRAPHS; TRANSCRIPTION FACTORS; EQUIVALENCE CLASSES; MARKOV EQUIVALENCE; CORRELATION MATRIX; GENE-EXPRESSION; ADAPTIVE LASSO; LATENT; SELECTION; MODEL;
D O I
10.1111/rssb.12315
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
We introduce a new method to estimate the Markov equivalence class of a directed acyclic graph (DAG) in the presence of hidden variables, in settings where the underlying DAG among the observed variables is sparse, and there are a few hidden variables that have a direct effect on many of the observed variables. Building on the so-called low rank plus sparse framework, we suggest a two-stage approach which first removes the effect of the hidden variables and then estimates the Markov equivalence class of the underlying DAG under the assumption that there are no remaining hidden variables. This approach is consistent in certain high dimensional regimes and performs favourably when compared with the state of the art, in terms of both graphical structure recovery and total causal effect estimation.
引用
收藏
页码:459 / 487
页数:29
相关论文
共 56 条
[1]  
Aguet F., 2016, TECHNICAL REPORT, DOI 10.1101/074450
[2]   MARKOV EQUIVALENCE FOR ANCESTRAL GRAPHS [J].
Ali, R. Ayesha ;
Richardson, Thomas S. ;
Spirtes, Peter .
ANNALS OF STATISTICS, 2009, 37 (5B) :2808-2837
[3]   A different paradigm for the initial colonisation of Sahul [J].
Allen, Jim ;
O'Connell, James F. .
ARCHAEOLOGY IN OCEANIA, 2020, 55 (01) :1-14
[4]  
Andersson SA, 1997, ANN STAT, V25, P505
[5]  
[Anonymous], 1977, Lec. Notes Math., DOI 10.1007/BFb0069178
[6]  
[Anonymous], 2013, UAI
[7]   Robust Principal Component Analysis? [J].
Candes, Emmanuel J. ;
Li, Xiaodong ;
Ma, Yi ;
Wright, John .
JOURNAL OF THE ACM, 2011, 58 (03)
[8]   LATENT VARIABLE GRAPHICAL MODEL SELECTION VIA CONVEX OPTIMIZATION [J].
Chandrasekaran, Venkat ;
Parrilo, Pablo A. ;
Willsky, Alan S. .
ANNALS OF STATISTICS, 2012, 40 (04) :1935-1967
[9]   RANK-SPARSITY INCOHERENCE FOR MATRIX DECOMPOSITION [J].
Chandrasekaran, Venkat ;
Sanghavi, Sujay ;
Parrilo, Pablo A. ;
Willsky, Alan S. .
SIAM JOURNAL ON OPTIMIZATION, 2011, 21 (02) :572-596
[10]   Learning equivalence classes of Bayesian-network structures [J].
Chickering, DM .
JOURNAL OF MACHINE LEARNING RESEARCH, 2002, 2 (03) :445-498