Structure and Randomness of Continuous-Time, Discrete-Event Processes

被引:22
作者
Marzen, Sarah E. [1 ,2 ]
Crutchfield, James P. [3 ]
机构
[1] MIT, Dept Phys, Phys Living Syst Grp, Cambridge, MA 02139 USA
[2] Univ Calif Berkeley, Dept Phys, Berkeley, CA 94720 USA
[3] Univ Calif Davis, Dept Phys, Complex Sci Ctr, One Shields Ave, Davis, CA 95616 USA
基金
美国国家科学基金会;
关键词
Epsilon-machines; Causal states; Entropy rate; Statistical complexity; Hidden Markov processes; COMPLEXITY; ORDER;
D O I
10.1007/s10955-017-1859-y
中图分类号
O4 [物理学];
学科分类号
0702 ;
摘要
Loosely speaking, the Shannon entropy rate is used to gauge a stochastic process' intrinsic randomness; the statistical complexity gives the cost of predicting the process. We calculate, for the first time, the entropy rate and statistical complexity of stochastic processes generated by finite unifilar hidden semi-Markov models-memoryful, state-dependent versions of renewal processes. Calculating these quantities requires introducing novel mathematical objects (-machines of hidden semi-Markov processes) and new information-theoretic methods to stochastic processes.
引用
收藏
页码:303 / 315
页数:13
相关论文
共 50 条
  • [21] Fault Diagnosis in Discrete-Event Systems: Incomplete Models and Learning
    Kwong, Raymond H.
    Yonge-Mallo, David L.
    IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS, 2011, 41 (01): : 118 - 130
  • [22] Discrete-Event Simulation Model Generation based on Activity Metrics
    Capocchi L.
    Santucci J.F.
    Pawletta T.
    Folkerts H.
    Zeigler B.P.
    Simulation Modelling Practice and Theory, 2020, 103
  • [23] An improved approach for verifying delayed detectability of discrete-event systems
    Liu, Yang
    Liu, Zhaocong
    Yin, Xiang
    Li, Shaoyuan
    AUTOMATICA, 2021, 124
  • [24] Robust Diagnosability and Robust Prognosability of Discrete-Event Systems Revisited
    Yin, Xiang
    Li, Shaoyuan
    2018 IEEE 8TH ANNUAL INTERNATIONAL CONFERENCE ON CYBER TECHNOLOGY IN AUTOMATION, CONTROL, AND INTELLIGENT SYSTEMS (IEEE-CYBER), 2018, : 302 - 307
  • [25] Superior memory efficiency of quantum devices for the simulation of continuous-time stochastic processes
    Elliott, Thomas J.
    Gu, Mile
    NPJ QUANTUM INFORMATION, 2018, 4
  • [26] Recursive Discrete-Time Models for Continuous-Time Systems Under Band-Limited Assumptions
    Relan, Rishi
    Schoukens, Johan
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2016, 65 (03) : 713 - 723
  • [27] Improved Approaches for Verifying I-Detectability of Discrete-Event Systems
    Liu, Zhaocong
    Yin, Xiang
    Li, Shaoyuan
    2019 12TH ASIAN CONTROL CONFERENCE (ASCC), 2019, : 248 - 253
  • [28] Informational and Causal Architecture of Discrete-Time Renewal Processes
    Marzen, Sarah E.
    Crutchfield, James P.
    ENTROPY, 2015, 17 (07) : 4891 - 4917
  • [29] Fault Diagnosis in Discrete-Event Systems with Incomplete Models: Learnability and Diagnosability
    Kwong, Raymond H.
    Yonge-Mallo, David L.
    IEEE TRANSACTIONS ON CYBERNETICS, 2015, 45 (07) : 1236 - 1249
  • [30] Supervisory Control of Discrete-Event Systems for Infinite-Step Opacity
    Xie, Yifan
    Yin, Xiang
    2020 AMERICAN CONTROL CONFERENCE (ACC), 2020, : 3665 - 3671