DISCRETE RANDOM PROCESSES WITH MEMORY: MODELS AND APPLICATIONS

被引:2
作者
Kourim, Tomas [1 ]
Vole, Petr [2 ]
机构
[1] Czech Tech Univ, Fac Nucl Sci & Phys Engn, Brehova 7, Prague 11519 1, Czech Republic
[2] Acad Sci Czech Republ, Inst Informat Theory & Automat, Pod Vodarenskou Vezi 4, Prague 18200 8, Czech Republic
关键词
random walk; history dependent transition probability; non-Markov process; success punishing walk; success rewarding walk;
D O I
10.21136/AM.2020.0335-19
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
The contribution focuses on Bernoulli-like random walks, where the past events significantly affect the walk's future development. The main concern of the paper is therefore the formulation of models describing the dependence of transition probabilities on the process history. Such an impact can be incorporated explicitly and transition probabilities modulated using a few parameters reflecting the current state of the walk as well as the information about the past path. The behavior of proposed random walks, as well as the task of their parameter estimation, are studied both theoretically and with the aid of simulations.
引用
收藏
页码:271 / 286
页数:16
相关论文
共 50 条
  • [41] Spectral analysis of 1D nearest-neighbor random walks and applications to subdiffusive trap and barrier models
    Faggionato, Alessandra
    ELECTRONIC JOURNAL OF PROBABILITY, 2012, 17 : 1 - 36
  • [42] Random walks avoiding their convex hull with a finite memory
    Comets, Francis
    Menshikov, Mikhail V.
    Wade, Andrew R.
    INDAGATIONES MATHEMATICAE-NEW SERIES, 2020, 31 (01): : 117 - 146
  • [43] THE BEHAVIOR OF THE GENERATOR NORMALIZATION FACTOR IN APPROXIMATION OF RANDOM PROCESSES
    Yarova, O. A.
    Yeleyko, Ya I.
    CYBERNETICS AND SYSTEMS ANALYSIS, 2016, 52 (02) : 305 - 311
  • [44] High level subcritical branching processes in a random environment
    Afanasyev, V. I.
    PROCEEDINGS OF THE STEKLOV INSTITUTE OF MATHEMATICS, 2013, 282 (01) : 4 - 14
  • [45] Reduced branching processes in random environment: The critical case
    Vatutin, VA
    THEORY OF PROBABILITY AND ITS APPLICATIONS, 2002, 47 (01) : 99 - 113
  • [46] High level subcritical branching processes in a random environment
    V. I. Afanasyev
    Proceedings of the Steklov Institute of Mathematics, 2013, 282 : 4 - 14
  • [47] Random Walks and Branching Processes in Correlated Gaussian Environment
    Frank Aurzada
    Alexis Devulder
    Nadine Guillotin-Plantard
    Françoise Pène
    Journal of Statistical Physics, 2017, 166 : 1 - 23
  • [48] Branching processes in a random environment with immigration stopped at zero
    Dyakonova, Elena
    Li, Doudou
    Vatutin, Vladimir
    Zhang, Mei
    JOURNAL OF APPLIED PROBABILITY, 2020, 57 (01) : 237 - 249
  • [49] Random Walks and Branching Processes in Correlated Gaussian Environment
    Aurzada, Frank
    Devulder, Alexis
    Guillotin-Plantard, Nadine
    Pene, Francoise
    JOURNAL OF STATISTICAL PHYSICS, 2017, 166 (01) : 1 - 23
  • [50] TURNPIKES IN FINITE MARKOV DECISION PROCESSES AND RANDOM WALK*
    Piunovskiy, A. B.
    THEORY OF PROBABILITY AND ITS APPLICATIONS, 2023, 68 (01) : 123 - 149