Renyi and Tsallis entropies for incomplete or overcomplete systems of events

被引:6
作者
Campos, Diogenes [1 ]
机构
[1] Univ Jorge Tadeo Lozano, Fac Nat Sci & Engn, Bogota, Colombia
关键词
Renyi entropy; Tsallis entropy; Shannon entropy; Incomplete normalization; Overcomplete normalization; Escort probabilities; STATISTICAL-MECHANICS; INFORMATION THEORY; PHASE-SPACE;
D O I
10.1016/j.physa.2009.11.011
中图分类号
O4 [物理学];
学科分类号
0702 ;
摘要
In this article, Shannon, Renyi and Tsallis entropies are considered for a system of events characterized by an arbitrary probability distribution P that can be incomplete, complete or overcomplete. After a suitable transformation that leads to the escort probabilities of P, these can be written as the canonical probability distribution for a set of pseudo-energies (Hartley information, epsilon(n) = -In P(n)) and a dimensionless parameter q that plays the role of thermodynamics beta. Several relations between the entropies are presented, including the analysis of compound systems. The method is illustrated with an example. (C) 2009 Elsevier B.V. All rights reserved.
引用
收藏
页码:981 / 992
页数:12
相关论文
共 12 条
[1]  
Abramowitz M., 1970, HDB MATH FUNCTIONS
[2]  
[Anonymous], 1997, Thermodynamics of Chaotic Systems
[3]   A geometrical index for measuring species diversity [J].
Campos, Diogenes ;
Fernando Isaza, Jose .
ECOLOGICAL INDICATORS, 2009, 9 (04) :651-658
[4]   DIVERSITY AND EVENNESS: A UNIFYING NOTATION AND ITS CONSEQUENCES [J].
HILL, MO .
ECOLOGY, 1973, 54 (02) :427-432
[5]   INFORMATION THEORY AND STATISTICAL MECHANICS [J].
JAYNES, ET .
PHYSICAL REVIEW, 1957, 106 (04) :620-630
[6]  
MacKay D. J. C., 2003, Information Theory, Inference and Learning Algorithms
[7]  
Poole jr Ch.P., 2007, PHYS HDB FUNDAMENTAL
[8]   ON FOUNDATIONS OF INFORMATION THEORY [J].
RENYI, A .
REVUE DE L INSTITUT INTERNATIONAL DE STATISTIQUE-REVIEW OF THE INTERNATIONAL STATISTICAL INSTITUTE, 1965, 33 (01) :1-+
[9]   Asymptotically scale-invariant occupancy of phase space makes the entropy Sq extensive [J].
Tsallis, C ;
Gell-Mann, M ;
Sato, Y .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2005, 102 (43) :15377-15382
[10]   Incomplete information and fractal phase space [J].
Wang, QPA .
CHAOS SOLITONS & FRACTALS, 2004, 19 (03) :639-644