Entropic Compressibility of Levy Processes

被引:0
作者
Fageot, Julien [1 ]
Fallah, Alireza [2 ]
Horel, Thibaut [2 ]
机构
[1] Ecole Polytech Fed Lausanne EPFL, AudioVisual Commun Lab LCAV, CH-1015 Lausanne, Switzerland
[2] MIT, Lab Informat & Decis Syst, Cambridge, MA 02139 USA
基金
瑞士国家科学基金会;
关键词
Entropy; Indexes; Random variables; Quantization (signal); Random processes; Compounds; Random sequences; Levy processes; discrete entropy; differential entropy; local limit theorems; Blumenthal-Getoor index; WHITE-NOISE; EXISTENCE; CONTINUITY; DRIVEN; SPARSE;
D O I
10.1109/TIT.2022.3167863
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In contrast to their seemingly simple and shared structure of independence and stationarity, Levy processes exhibit a wide variety of behaviors, from the self-similar Wiener process to piecewise-constant compound Poisson processes. Inspired by the recent paper of Ghourchian, Amini, and Gohari, we characterize their compressibility by studying the entropy of their double discretization (both in time and amplitude) in the regime of vanishing discretization steps. For a Levy process with absolutely continuous marginals, this reduces to understanding the asymptotics of the differential entropy of its marginals at small times, for which we obtain a new local central limit theorem. We generalize known results for stable processes to the non-stable case, with a special focus on Levy processes that are locally self-similar, and conceptualize a new compressibility hierarchy of Levy processes, captured by their Blumenthal-Getoor index.
引用
收藏
页码:4949 / 4963
页数:15
相关论文
共 81 条
[1]   Compressibility of Deterministic and Random Infinite Sequences [J].
Amini, Arash ;
Unser, Michael ;
Marvasti, Farokh .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2011, 59 (11) :5193-5201
[2]  
[Anonymous], 2005, Elements of information theory
[3]  
[Anonymous], 2001, The Laplace Distribution and Generalizations: A Revisit With Applications to Communications, Economics, Engineering, and Finance
[4]  
[Anonymous], 1937, Theorie de l'Addition des Variables Aleatoires
[5]  
[Anonymous], 1994, Stochastic Models with Infinite Variance
[6]  
Applebaum David, 2009, Cambridge Stud. Adv. Math., V116
[7]   The Wavelet Compressibility of Compound Poisson Processes [J].
Aziznejad, Shayan ;
Fageot, Julien .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2022, 68 (04) :2752-2766
[8]   Wavelet analysis of the Besov regularity of Levy white noise [J].
Aziznejad, Shayan ;
Fageot, Julien .
ELECTRONIC JOURNAL OF PROBABILITY, 2020, 25 :1-38
[9]   Levy-based spatial-temporal modelling, with applications to turbulence [J].
Barndorff-Nielsen, OE ;
Schmiegel, J .
RUSSIAN MATHEMATICAL SURVEYS, 2004, 59 (01) :65-90
[10]   ENTROPY AND THE CENTRAL-LIMIT-THEOREM [J].
BARRON, AR .
ANNALS OF PROBABILITY, 1986, 14 (01) :336-342