A Gaussian process approximation for two-color randomly reinforced urns

被引:7
作者
Zhang, Li-Xin [1 ]
机构
[1] Zhejiang Univ, Dept Math, Hangzhou 310027, Zhejiang, Peoples R China
来源
ELECTRONIC JOURNAL OF PROBABILITY | 2014年 / 19卷
关键词
Reinforced urn model; Gaussian process; strong approximation; functional central limit theorem; Polya urn; law of the iterated logarithm; RESPONSE-ADAPTIVE DESIGNS; CENTRAL-LIMIT-THEOREM; ASYMPTOTIC PROPERTIES; MODELS;
D O I
10.1214/EJP.v19-3432
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
The Polya urn has been extensively studied and is widely applied in many disciplines. An important application is to use urn models to develop randomized treatment allocation schemes in clinical studies. As an extension of the Polya urn, the randomly reinforced urn was recently proposed to optimize clinical trials in the sense that patients are assigned to the best treatment with probability converging to one. In this paper, we prove a Gaussian process approximation for the sequence of random compositions of a two-color randomly reinforced urn for both the cases with the equal and unequal reinforcement means. By using the Gaussian approximation, the law of the iterated logarithm and the functional central limit theorem in both the stable convergence sense and the almost-sure conditional convergence sense are established. Also as a consequence, we are able to to prove that a random limit of the normalized urn composition has no point masses under the only assumption of finite (2 + epsilon)-th moments.
引用
收藏
页码:1 / 19
页数:19
相关论文
共 36 条
[1]   On the distribution of the limit proportion for a two-color, randomly reinforced urn with equal reinforcement distributions [J].
Aletti, Giacomo ;
May, Caterina ;
Secchi, Piercesare .
ADVANCES IN APPLIED PROBABILITY, 2007, 39 (03) :690-707
[2]   A CENTRAL LIMIT THEOREM, AND RELATED RESULTS, FOR A TWO-COLOR RANDOMLY REINFORCED URN [J].
Aletti, Giacomo ;
May, Caterina ;
Secchi, Piercesare .
ADVANCES IN APPLIED PROBABILITY, 2009, 41 (03) :829-844
[3]  
Bai Z. D., 2005, ANN APPL PROBAB, V12, P914
[4]  
Bai ZD, 2002, ANN APPL PROBAB, V12, P1149
[5]  
Bai ZD, 2002, ANN STAT, V30, P122
[6]   On the convergence of reinforcement learning [J].
Beggs, AW .
JOURNAL OF ECONOMIC THEORY, 2005, 122 (01) :1-36
[7]  
Berti P, 2011, J APPL PROBAB, V48, P527
[8]   Central limit theorems for multicolor urns with dominated colors [J].
Berti, Patrizia ;
Crimaldi, Irene ;
Pratelli, Luca ;
Rigo, Pietro .
STOCHASTIC PROCESSES AND THEIR APPLICATIONS, 2010, 120 (08) :1473-1491
[9]   LIMIT DISTRIBUTIONS FOR LARGE POLYA URNS [J].
Chauvin, Brigitte ;
Pouyanne, Nicolas ;
Sahnoun, Reda .
ANNALS OF APPLIED PROBABILITY, 2011, 21 (01) :1-32
[10]  
Crimaldi I., 2009, Int. Math. Forum, V4, P1139