System identification using autoregressive Bayesian neural networks with nonparametric noise models

被引:1
作者
Merkatas, Christos [1 ]
Sarkka, Simo [1 ]
机构
[1] Aalto Univ, Dept Elect Engn & Automat, Otakaari 3, Espoo 02150, Finland
基金
芬兰科学院;
关键词
Bayesian nonparametrics; geometric stick breaking; infinite mixture models; nonlinear time series; system identification; NONLINEAR DYNAMICAL-SYSTEMS; TIME-SERIES; RECONSTRUCTIONS; PREDICTIONS; REGRESSION; INFERENCE; SELECTION; VARIANCE;
D O I
10.1111/jtsa.12669
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
System identification is of special interest in science and engineering. This article is concerned with a system identification problem arising in stochastic dynamic systems, where the aim is to estimate the parameters of a system along with its unknown noise processes. In particular, we propose a Bayesian nonparametric approach for system identification in discrete time nonlinear random dynamical systems assuming only the order of the Markov process is known. The proposed method replaces the assumption of Gaussian distributed error components with a flexible family of probability density functions based on Bayesian nonparametric priors. Additionally, the functional form of the system is estimated by leveraging Bayesian neural networks, which leads to flexible uncertainty quantification. Hamiltonian Monte Carlo sampler within a Gibbs sampler for posterior inference is proposed and its effectiveness is illustrated in real time series.
引用
收藏
页码:319 / 330
页数:12
相关论文
共 50 条
[31]   System Identification of a Cooling Coil Using Recurrent Neural Networks [J].
Muhammad Bilal Kadri .
Arabian Journal for Science and Engineering, 2012, 37 :2193-2203
[32]   An inverse parameter identification procedure assessing the quality of the estimates using Bayesian neural networks [J].
Unger, Jorg F. ;
Koenke, Carsten .
APPLIED SOFT COMPUTING, 2011, 11 (04) :3357-3367
[33]   Estimating Genome-Wide Gene Networks Using Nonparametric Bayesian Network Models on Massively Parallel Computers [J].
Tamada, Yoshinori ;
Imoto, Seiya ;
Araki, Hiromitsu ;
Nagasaki, Masao ;
Print, Cristin ;
Charnock-Jones, D. Stephen ;
Miyano, Satoru .
IEEE-ACM TRANSACTIONS ON COMPUTATIONAL BIOLOGY AND BIOINFORMATICS, 2011, 8 (03) :683-697
[34]   a priori uncertainty quantification of reacting turbulence closure models using Bayesian neural networks [J].
Pash, Graham ;
Hassanaly, Malik ;
Yellapantula, Shashank .
ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2025, 141
[35]   Fast Search and Estimation of Bayesian Nonparametric Mixture Models Using a Classification Annealing EM Algorithm [J].
Karabatsos, George .
JOURNAL OF COMPUTATIONAL AND GRAPHICAL STATISTICS, 2021, 30 (01) :236-247
[36]   A nonparametric Bayesian model for system identification based on a super-Gaussian distribution [J].
Tanji, Hiroki ;
Murakami, Takahiro ;
Kamata, Hiroyuki .
ELECTRONICS AND COMMUNICATIONS IN JAPAN, 2019, 102 (07) :32-40
[37]   A nonparametric Bayesian model for system identification based on a super-Gaussian distribution [J].
Tanji H. ;
Murakami T. ;
Kamata H. .
IEEJ Transactions on Electronics, Information and Systems, 2019, 139 (04) :380-387
[38]   Bayesian Filtering in Spiking Neural Networks: Noise, Adaptation, and Multisensory Integration [J].
Bobrowski, Omer ;
Meir, Ron ;
Eldar, Yonina C. .
NEURAL COMPUTATION, 2009, 21 (05) :1277-1320
[39]   Gaussian mixture models for training Bayesian convolutional neural networks [J].
Mostafa, Bakhouya ;
Hassan, Ramchoun ;
Mohammed, Hadda ;
Tawfik, Masrour .
EVOLUTIONARY INTELLIGENCE, 2024, 17 (04) :2515-2536
[40]   Enhanced Hammerstein Models Identification Using Multiple Hidden Layers Neural Networks [J].
da Silva, Matheus F. ;
da Silva, Moises T. ;
Barros, Pericles R. ;
Junior, George A. .
CIRCUITS SYSTEMS AND SIGNAL PROCESSING, 2025, 44 (07) :4669-4703