COMPUTATION OF MAXIMUM LIKELIHOOD ESTIMATES IN CYCLIC STRUCTURAL EQUATION MODELS

被引:5
作者
Drton, Mathias [1 ]
Fox, Christopher [2 ]
Wang, Y. Samuel [1 ]
机构
[1] Univ Washington, Dept Stat, Seattle, WA 98195 USA
[2] Univ Chicago, Dept Stat, Chicago, IL 60637 USA
关键词
Cyclic graph; feedback; linear structural equation model; graphical model; maximum likelihood estimation; PACKAGE; MATRIX;
D O I
10.1214/17-AOS1602
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
Software for computation of maximum likelihood estimates in linear structural equation models typically employs general techniques from nonlinear optimization, such as quasi-Newton methods. In practice, careful tuning of initial values is often required to avoid convergence issues. As an alternative approach, we propose a block-coordinate descent method that cycles through the considered variables, updating only the parameters related to a given variable in each step. We show that the resulting block update problems can be solved in closed form even when the structural equation model comprises feedback cycles. Furthermore, we give a characterization of the models for which the block-coordinate descent algorithm is well defined, meaning that for generic data and starting values all block optimization problems admit a unique solution. For the characterization, we represent each model by its mixed graph (also known as path diagram), which leads to criteria that can be checked in time that is polynomial in the number of considered variables.
引用
收藏
页码:663 / 690
页数:28
相关论文
共 41 条
  • [1] Anderson T. W., 2003, An introduction to multivariate statistical analysis, V3rd
  • [2] [Anonymous], 2009, Lectures on algebraic statistics, volume 39 of Oberwolfach Seminars, DOI [DOI 10.1007/978-3-7643-8905-5, 10.1007/978-3-7643-8905-5]
  • [3] [Anonymous], ARXIV150801717
  • [4] [Anonymous], 1999, Subsampling, DOI DOI 10.1007/978-1-4612-1554-7
  • [5] Bollen K. A., 1989, STRUCTURAL EQUATIONS, DOI DOI 10.1002/9781118619179
  • [6] Estimation of a covariance matrix with zeros
    Chaudhuri, Sanjay
    Drton, Mathias
    Richardson, Thomas S.
    [J]. BIOMETRIKA, 2007, 94 (01) : 199 - 216
  • [7] LEARNING HIGH-DIMENSIONAL DIRECTED ACYCLIC GRAPHS WITH LATENT AND SELECTION VARIABLES
    Colombo, Diego
    Maathuis, Marloes H.
    Kalisch, Markus
    Richardson, Thomas S.
    [J]. ANNALS OF STATISTICS, 2012, 40 (01) : 294 - 321
  • [8] Multimodality of the likelihood in the bivariate seemingly unrelated regressions model
    Drton, M
    Richardson, TS
    [J]. BIOMETRIKA, 2004, 91 (02) : 383 - 392
  • [9] Drton M., 2018, COMPUTATION MAXIMU S, DOI [10.1214/17-AOS1602SUPP, DOI 10.1214/17-AOS1602SUPP]
  • [10] Structure Learning in Graphical Modeling
    Drton, Mathias
    Maathuis, Marloes H.
    [J]. ANNUAL REVIEW OF STATISTICS AND ITS APPLICATION, VOL 4, 2017, 4 : 365 - 393