Some properties of Renyi entropy and Renyi entropy rate

被引：74

作者：

Golshani, Leila ^{[1
]}

Pasha, Einollah ^{[2
]}

Yari, Gholamhossein ^{[3
]}

机构：

[1] Islamic Azad Univ, Sci & Res Branch, Dept Stat, Tehran 1477893855, Iran

[2] Tarbiat Moallem Univ, Tehran, Iran

[3] Univ Sci & Technol, Tehran, Iran

来源：

INFORMATION SCIENCES | 2009年 / 179卷 / 14期

关键词：

Renyi entropy; Shannon entropy; Renyi entropy rate; Shannon entropy rate; Stationary process; Quasi-linear mean; INFORMATION; CONVERGENCE; FUNCTIONALS; DIVERGENCE; SYSTEMS;

D O I：

10.1016/j.ins.2009.03.002

中图分类号：

TP [自动化技术、计算机技术];

学科分类号：

0812 ;

摘要：

In this paper, we define the conditional Renyi entropy and show that the so-called chain rule holds for the Renyi entropy. Then, we introduce a relation for the rate of Renyi entropy and use it to derive the rate of the Renyi entropy for an irreducible-aperiodic Markov chain. We also show that the bound for the Renyi entropy rate is simply the Shannon entropy rate. (C) 2009 Elsevier Inc. All rights reserved.

引用

页码：2426 / 2433

页数：8

共 34 条

[1] On the geometry of generalized Gaussian distributions [J].

Andai, Attila .

JOURNAL OF MULTIVARIATE ANALYSIS, 2009, 100 (04) :777-793

[2]

[Anonymous], 1957, Mathematical foundations of information theory

[3]

[Anonymous], BELL SYST TECH J

[4]

[Anonymous], 1991, ELEMENTS INFORM THEO

[5] Long memory and volatility clustering: Is the empirical evidence consistent across stock markets? [J].

Bentes, Sonia R. ;

Menezes, Rui ;

Mendes, Diana A. .

PHYSICA A-STATISTICAL MECHANICS AND ITS APPLICATIONS, 2008, 387 (15) :3826-3830

[6] On some entropy functionals derived from Renyi information divergence [J].

Bercher, J. -F. .

INFORMATION SCIENCES, 2008, 178 (12) :2489-2506

[7]

Cachin C., 1997, THESIS SWISS FEDERAL

[8] GENERALIZED CUTOFF RATES AND RENYIS INFORMATION MEASURES [J].

CSISZAR, I .

IEEE TRANSACTIONS ON INFORMATION THEORY, 1995, 41 (01) :26-34

[9]

DEGREGORIO A, 2009, INFORM SCI, P279

[10] Gelfand-Yaglom-Perez theorem for generalized relative entropy functionals [J].

Dukkipati, Ambedkar ;

Bhatnagar, Shalabh ;

Murty, M. Narasimha .

INFORMATION SCIENCES, 2007, 177 (24) :5707-5714

← 1 2 3 4 →