DISCRETE RANDOM PROCESSES WITH MEMORY: MODELS AND APPLICATIONS

被引:2
|
作者
Kourim, Tomas [1 ]
Vole, Petr [2 ]
机构
[1] Czech Tech Univ, Fac Nucl Sci & Phys Engn, Brehova 7, Prague 11519 1, Czech Republic
[2] Acad Sci Czech Republ, Inst Informat Theory & Automat, Pod Vodarenskou Vezi 4, Prague 18200 8, Czech Republic
关键词
random walk; history dependent transition probability; non-Markov process; success punishing walk; success rewarding walk;
D O I
10.21136/AM.2020.0335-19
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
The contribution focuses on Bernoulli-like random walks, where the past events significantly affect the walk's future development. The main concern of the paper is therefore the formulation of models describing the dependence of transition probabilities on the process history. Such an impact can be incorporated explicitly and transition probabilities modulated using a few parameters reflecting the current state of the walk as well as the information about the past path. The behavior of proposed random walks, as well as the task of their parameter estimation, are studied both theoretically and with the aid of simulations.
引用
收藏
页码:271 / 286
页数:16
相关论文
共 50 条
  • [21] Random polymers and generalized urn processes
    Franchini, Simone
    Balzan, Riccardo
    PHYSICAL REVIEW E, 2018, 98 (04)
  • [22] Criticality for branching processes in random environment
    Afanasyev, VI
    Geiger, J
    Kersting, G
    Vatutin, VA
    ANNALS OF PROBABILITY, 2005, 33 (02) : 645 - 673
  • [23] On coupling of random walks and renewal processes
    Lindvall, T
    Rogers, LCG
    JOURNAL OF APPLIED PROBABILITY, 1996, 33 (01) : 122 - 126
  • [24] Random walk in shortcut models
    Shanker, O.
    MODERN PHYSICS LETTERS B, 2008, 22 (10): : 727 - 733
  • [25] Random walk models in biology
    Codling, Edward A.
    Plank, Michael J.
    Benhamou, Simon
    JOURNAL OF THE ROYAL SOCIETY INTERFACE, 2008, 5 (25) : 813 - 834
  • [26] Random walk in a discrete and continuous system with a thin membrane
    Kosztolowicz, T
    PHYSICA A-STATISTICAL MECHANICS AND ITS APPLICATIONS, 2001, 298 (3-4) : 285 - 296
  • [27] Asymptotic entropy of the ranges of random walks on discrete groups
    Xinxing Chen
    Jiansheng Xie
    Minzhi Zhao
    Science China(Mathematics), 2020, 63 (06) : 1153 - 1168
  • [28] Asymptotic entropy of the ranges of random walks on discrete groups
    Xinxing Chen
    Jiansheng Xie
    Minzhi Zhao
    Science China Mathematics, 2020, 63 : 1153 - 1168
  • [29] Asymptotic entropy of the ranges of random walks on discrete groups
    Chen, Xinxing
    Xie, Jiansheng
    Zhao, Minzhi
    SCIENCE CHINA-MATHEMATICS, 2020, 63 (06) : 1153 - 1168
  • [30] Random walks on discrete groups of polynomial volume growth
    Alexopoulos, GK
    ANNALS OF PROBABILITY, 2002, 30 (02) : 723 - 801