Flexible Extensions to Structural Equation Models Using Computation Graphs

被引:9
作者
van Kesteren, Erik-Jan [1 ]
Oberski, Daniel L. [1 ]
机构
[1] Univ Utrecht, Utrecht, Netherlands
关键词
Structural equation modeling; computation graphs; deep learning; optimization; regularization; COVARIANCE STRUCTURE-ANALYSIS; MAXIMUM-LIKELIHOOD; VARIABLE-SELECTION; PENALIZED LIKELIHOOD; LEAST-SQUARES; REGULARIZATION; HYPOTHESIS; GRADIENT; PRIORS;
D O I
10.1080/10705511.2021.1971527
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
Structural equation modeling (SEM) is being applied to ever more complex data types and questions, often requiring extensions such as regularization or novel fitting functions. To extend SEM, researchers currently need to completely reformulate SEM and its optimization algorithm - a challenging and time-consuming task. In this paper, we introduce the computation graph for SEM, and show that this approach can extend SEM without the need for bespoke software development. We show that both existing and novel SEM improvements follow naturally. To demonstrate, we introduce three SEM extensions: least absolute deviation estimation, Bayesian LASSO optimization, and sparse high-dimensional mediation analysis. We provide an implementation of SEM in PyTorch - popular software in the machine learning community - to accelerate development of structural equation models adequate for modern-day data and research questions.
引用
收藏
页码:233 / 247
页数:15
相关论文
共 80 条
[1]  
Abadi M, 2016, PROCEEDINGS OF OSDI'16: 12TH USENIX SYMPOSIUM ON OPERATING SYSTEMS DESIGN AND IMPLEMENTATION, P265
[2]  
[Anonymous], 2002, Torch: A Modular Machine Learning Software Library
[3]   Dynamic Structural Equation Models [J].
Asparouhov, Tihomir ;
Hamaker, Ellen L. ;
Muthen, Bengt .
STRUCTURAL EQUATION MODELING-A MULTIDISCIPLINARY JOURNAL, 2018, 25 (03) :359-388
[4]   Structural Equation Models and Mixture Models With Continuous Nonnormal Skewed Distributions [J].
Asparouhov, Tihomir ;
Muthen, Bengt .
STRUCTURAL EQUATION MODELING-A MULTIDISCIPLINARY JOURNAL, 2016, 23 (01) :1-19
[5]   Exploratory Structural Equation Modeling [J].
Asparouhov, Tihomir ;
Muthen, Bengt .
STRUCTURAL EQUATION MODELING-A MULTIDISCIPLINARY JOURNAL, 2009, 16 (03) :397-438
[6]   Approximate residual balancing: debiased inference of average treatment effects in high dimensions [J].
Athey, Susan ;
Imbens, Guido W. ;
Wager, Stefan .
JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-STATISTICAL METHODOLOGY, 2018, 80 (04) :597-623
[7]   Gradient-based optimization of hyperparameters [J].
Bengio, Y .
NEURAL COMPUTATION, 2000, 12 (08) :1889-1900
[8]  
Betancourt M., 2017, ARXIV
[9]   ANALYSIS OF COVARIANCE STRUCTURES [J].
BOCK, RD ;
BARGMANN, RE .
PSYCHOMETRIKA, 1966, 31 (04) :507-507
[10]  
Bollen K. A., 1989, Structural Equations with Latent Variables, DOI DOI 10.1002/9781118619179