DISCRETE RANDOM PROCESSES WITH MEMORY: MODELS AND APPLICATIONS

被引:2
|
作者
Kourim, Tomas [1 ]
Vole, Petr [2 ]
机构
[1] Czech Tech Univ, Fac Nucl Sci & Phys Engn, Brehova 7, Prague 11519 1, Czech Republic
[2] Acad Sci Czech Republ, Inst Informat Theory & Automat, Pod Vodarenskou Vezi 4, Prague 18200 8, Czech Republic
关键词
random walk; history dependent transition probability; non-Markov process; success punishing walk; success rewarding walk;
D O I
10.21136/AM.2020.0335-19
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
The contribution focuses on Bernoulli-like random walks, where the past events significantly affect the walk's future development. The main concern of the paper is therefore the formulation of models describing the dependence of transition probabilities on the process history. Such an impact can be incorporated explicitly and transition probabilities modulated using a few parameters reflecting the current state of the walk as well as the information about the past path. The behavior of proposed random walks, as well as the task of their parameter estimation, are studied both theoretically and with the aid of simulations.
引用
收藏
页码:271 / 286
页数:16
相关论文
共 50 条
  • [1] Discrete Random Processes with Memory: Models and Applications
    Tomáš Kouřim
    Petr Volf
    Applications of Mathematics, 2020, 65 : 271 - 286
  • [2] Discrete choice models based on random walks
    Berbeglia, Gerardo
    OPERATIONS RESEARCH LETTERS, 2016, 44 (02) : 234 - 237
  • [3] Distribution of shifted discrete random walk generated by distinct random variables and applications in ruin theory
    Gerve, Simonas
    Grigutis, Andrius
    MODERN STOCHASTICS-THEORY AND APPLICATIONS, 2024, 11 (03): : 323 - 357
  • [4] Maximum-likelihood estimators and random walks in long memory models
    Bertin, Karine
    Torres, Soledad
    Tudor, Ciprian A.
    STATISTICS, 2011, 45 (04) : 361 - 374
  • [5] Random walk on a discrete torus and random interlacements
    Windisch, David
    ELECTRONIC COMMUNICATIONS IN PROBABILITY, 2008, 13 : 140 - 150
  • [6] Stochastic models in seed dispersals: random walks and birth-death processes
    Abdullahi, A.
    Shohaimi, S.
    Kilicman, A.
    Ibrahim, M. H.
    JOURNAL OF BIOLOGICAL DYNAMICS, 2019, 13 (01) : 345 - 361
  • [7] A discrete random walk on the hypercube
    Zhang, Jingyuan
    Xiang, Yonghong
    Sun, Weigang
    PHYSICA A-STATISTICAL MECHANICS AND ITS APPLICATIONS, 2018, 494 : 1 - 7
  • [8] RANDOM WALKS ON DISCRETE CYLINDERS WITH LARGE BASES AND RANDOM INTERLACEMENTS
    Windisch, David
    ANNALS OF PROBABILITY, 2010, 38 (02) : 841 - 895
  • [9] Discrete-time random motion in a continuous random medium
    Boldrighini, C.
    Minlos, R. A.
    Pellegrinotti, A.
    STOCHASTIC PROCESSES AND THEIR APPLICATIONS, 2009, 119 (10) : 3285 - 3299
  • [10] Discrete random walks on the group Sol
    Jérémie Brieussel
    Ryokichi Tanaka
    Israel Journal of Mathematics, 2015, 208 : 291 - 321