A factor graph approach to automated design of Bayesian signal processing algorithms

被引:33
作者
Cox, Marco [1 ]
van de Laar, Thijs [1 ]
de Vries, Bert [1 ,2 ]
机构
[1] Eindhoven Univ Technol, Dept Elect Engn, POB 513, NL-6500 MB Eindhoven, Netherlands
[2] GN Hearing, Eeuwsel 6, NL-5612 AS Eindhoven, Netherlands
关键词
Probabilistic programming; Bayesian inference; Julia; Factor graphs; Message passing; SEMIPARAMETRIC REGRESSION-MODELS; FAST APPROXIMATE INFERENCE; BINARY;
D O I
10.1016/j.ijar.2018.11.002
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The benefits of automating design cycles for Bayesian inference-based algorithms are becoming increasingly recognized by the machine learning community. As a result, interest in probabilistic programming frameworks has much increased over the past few years. This paper explores a specific probabilistic programming paradigm, namely message passing in Forney-style factor graphs (FFGs), in the context of automated design of efficient Bayesian signal processing algorithms. To this end, we developed "ForneyLab("2) as a Julia toolbox for message passing-based inference in FFGs. We show by example how ForneyLab enables automatic derivation of Bayesian signal processing algorithms, including algorithms for parameter estimation and model comparison. Crucially, due to the modular makeup of the FFG framework, both the model specification and inference methods are readily extensible in FomeyLab. In order to test this framework, we compared variational message passing as implemented by ForneyLab with automatic differentiation variational inference (ADVI) and Monte Carlo methods as implemented by state-of-the-art tools "Edward" and "Stan". In terms of performance, extensibility and stability issues, ForneyLab appears to enjoy an edge relative to its competitors for automated inference in state-space models. (C) 2018 Elsevier Inc. All rights reserved.
引用
收藏
页码:185 / 204
页数:20
相关论文
共 46 条
  • [21] Harva M., ARXIV12071380
  • [22] Hershey S., ARXIV12122991CSSTAT
  • [23] Hipel KW, 1994, TIME SERIES MODELLIN
  • [24] Jitkrittum W., 2015, P 31 C AMST NETH
  • [25] Knowles D.A., 2011, ADV NEURAL INF PROCE, P1701
  • [26] Korl S., 2005, A factor graph approach to signal modelling, system identification and filtering
  • [27] Kucukelbir A, 2017, J MACH LEARN RES, V18, P1
  • [28] Kucukelbir A, 2015, ADV NEUR IN, V28
  • [29] Kuss M, 2005, J MACH LEARN RES, V6, P1679
  • [30] An introduction to factor graphs
    Loeliger, HA
    [J]. IEEE SIGNAL PROCESSING MAGAZINE, 2004, 21 (01) : 28 - 41