Large deviations asymptotics and the spectral theory of multiplicatively regular Markov processes

被引:86
作者
Kontoyiannis, I
Meyn, SP
机构
[1] Brown Univ, Div Appl Math, Providence, RI 02912 USA
[2] Brown Univ, Dept Comp Sci, Providence, RI 02912 USA
[3] Univ Illinois, Dept Elect & Comp Engn, Urbana, IL 61801 USA
基金
美国国家科学基金会;
关键词
Markov process; large deviations; entropy; stochastic Lyapunov function; empirical measures; nonlinear generator; large deviations principle;
D O I
10.1214/EJP.v10-231
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
In this paper we continue the investigation of the spectral theory and exponential asymptotics of primarily discrete-time Markov processes, following Kontoyiannis and Meyn [32]. We introduce a new family of nonlinear Lyapunov drift criteria, which characterize distinct subclasses of geometrically ergodic Markov processes in terms of simple inequalities for the nonlinear generator. We concentrate primarily on the class of multiplicatively regular Markov processes, which are characterized via simple conditions similar to (but weaker than) those of Donsker-Varadhan. For any such process Phi ={Phi(t)} with transition kernel P on a general state space X, the following are obtained. Spectral Theory: For a large class of (possibly unbounded) functionals F : X --> C, the kernel (P) over cap (x, dy) = e(F(x))P(x, dy) has a discrete spectrum in an appropriately defined Banach space. It follows that there exists a "maximal" solution (lambda, f) to the multiplicative Poisson equation, defined as the eigenvalue problem (P) over capf = lambdaf. The functional Lambda(F) = log(lambda) is convex, smooth, and its convex dual Lambda* is convex, with compact sublevel sets. Multiplicative Mean Ergodic Theorem: Consider the partial sums {S-t} of the process with respect to any one of the functionals F(Phi(t)) considered above. The normalized mean E-x [exp(S-t)] (and not the logarithm of the mean) converges to f (x) exponentially fast, where f is the above solution of the multiphcative Poisson equation. Multiplicative regularity: The Lyapunov drift criterion under which our results are derived is equivalent to the existence of regeneration times with finite exponential moments for the partial sums {S-t}, with respect to any functional F in the above class. Large Deviations: The sequence of empirical measures of {Phi(t)} satisfies a large deviations principle in the "tau(Wo)-topology," a topology finer that the usual tau-topology, generated by the above class of functionals F on X which is strictly larger than L-infinity(X). The rate function of this LDP is Lambda*, and it is shown to coincide with the Donsker-Varadhan rate function in terms of relative entropy. Exact Large Deviations Asymptotics: The above partial sums {S-t} are shown to satisfy an exact large deviations expansion, analogous to that obtained by Bahadur and Ranga Rao for independent random variables.
引用
收藏
页码:61 / 123
页数:63
相关论文
共 44 条
[1]  
[Anonymous], CAMBRIDGE STUDIES AD
[2]   ON DEVIATIONS OF THE SAMPLE-MEAN [J].
BAHADUR, RR ;
RAO, RR .
ANNALS OF MATHEMATICAL STATISTICS, 1960, 31 (04) :1015-1027
[3]   Multiplicative ergodicity and large deviations for an irreducible Markov chain [J].
Balaji, S ;
Meyn, SP .
STOCHASTIC PROCESSES AND THEIR APPLICATIONS, 2000, 90 (01) :123-144
[4]   SOME POTENTIAL-THEORY FOR REFLECTING BROWNIAN-MOTION IN HOLDER AND LIPSCHITZ-DOMAINS [J].
BASS, RF ;
PEI, H .
ANNALS OF PROBABILITY, 1991, 19 (02) :486-508
[5]   MARKOV PROCESS LARGE DEVIATIONS IN TAU-TOPOLOGY [J].
BOLTHAUSEN, E .
STOCHASTIC PROCESSES AND THEIR APPLICATIONS, 1987, 25 (01) :95-108
[6]   Metastability and small eigenvalues in Markov chains [J].
Bovier, A ;
Eckhoff, M ;
Gayrard, V ;
Klein, M .
JOURNAL OF PHYSICS A-MATHEMATICAL AND GENERAL, 2000, 33 (46) :L447-L451
[7]  
BOYD S, 2002, UNPUB CONVEX OPTIMIZ
[8]   STRONG LARGE DEVIATION AND LOCAL LIMIT-THEOREMS [J].
CHAGANTY, NR ;
SETHURAMAN, J .
ANNALS OF PROBABILITY, 1993, 21 (03) :1671-1690
[9]  
Davies EB, 2000, J OPERAT THEOR, V43, P243
[10]  
Dawson D. A., 1987, Stochastics, V20, P247, DOI 10.1080/17442508708833446