Inference, Prediction, & Entropy-Rate Estimation of Continuous-Time, Discrete-Event Processes

被引:0
作者
Marzen, Sarah E. [1 ,2 ]
Crutchfield, James P. [3 ,4 ]
机构
[1] Pitzer, WM Keck Sci Dept, Scripps, Claremont, CA 91711 USA
[2] Claremont McKenna Coll, Claremont, CA 91711 USA
[3] Univ Calif Davis, Complex Sci Ctr, One Shields Ave, Davis, CA 95616 USA
[4] Univ Calif Davis, Phys & Astron Dept, One Shields Ave, Davis, CA 95616 USA
关键词
Poisson process; renewal process; hidden semi-Markov process; hidden Markov chain; epsilon-machine; Shannon entropy rate; optimal predictor; minimal predictor; NETWORKS; PREDICTABILITY; RANDOMNESS; COMPLEXITY;
D O I
10.3390/e24111675
中图分类号
O4 [物理学];
学科分类号
0702 ;
摘要
Inferring models, predicting the future, and estimating the entropy rate of discrete-time, discrete-event processes is well-worn ground. However, a much broader class of discrete-event processes operates in continuous-time. Here, we provide new methods for inferring, predicting, and estimating them. The methods rely on an extension of Bayesian structural inference that takes advantage of neural network's universal approximation power. Based on experiments with complex synthetic data, the methods are competitive with the state-of-the-art for prediction and entropy-rate estimation.
引用
收藏
页数:15
相关论文
共 49 条
[31]  
Magdon-Ismail M, 1999, ADV NEUR IN, V11, P522
[32]   A COMPARISON OF CROSS-VALIDATION TECHNIQUES IN DENSITY-ESTIMATION [J].
MARRON, JS .
ANNALS OF STATISTICS, 1987, 15 (01) :152-162
[33]   Informational and Causal Architecture of Continuous-time Renewal Processes [J].
Marzen, Sarah ;
Crutchfield, James P. .
JOURNAL OF STATISTICAL PHYSICS, 2017, 168 (01) :109-127
[34]   Structure and Randomness of Continuous-Time, Discrete-Event Processes [J].
Marzen, Sarah E. ;
Crutchfield, James P. .
JOURNAL OF STATISTICAL PHYSICS, 2017, 169 (02) :303-315
[35]   Modeling the Dynamics of Learning Activity on the Web [J].
Mavroforakis, Charalampos ;
Valera, Isabel ;
Rodriguez, Manuel Gomez .
PROCEEDINGS OF THE 26TH INTERNATIONAL CONFERENCE ON WORLD WIDE WEB (WWW'17), 2017, :1421-1430
[36]  
Mei HY, 2017, ADV NEUR IN, V30
[37]   GENERALIZED LINEAR MODELS [J].
NELDER, JA ;
WEDDERBURN, RW .
JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES A-GENERAL, 1972, 135 (03) :370-+
[38]  
Nemenman I, 2002, ADV NEUR IN, V14, P471
[39]  
Pfau D., 2010, ADV NEURAL INFO PROC, V23, P1930
[40]  
Rieke F., 1999, Spikes: Exploring the Neural Code