Minimax Renyi Redundancy

被引：4

作者：

Yagli, Semih ^{[1
]}

Altug, Yucel ^{[2
]}

Verdu, Sergio ^{[1
]}

机构：

[1] Princeton Univ, Dept Elect Engn, Princeton, NJ 08544 USA

[2] Natera Inc, San Carlos, CA 94070 USA

来源：

IEEE TRANSACTIONS ON INFORMATION THEORY | 2018年 / 64卷 / 05期

基金：

美国国家科学基金会;

关键词：

Universal lossless compression; generalized redundancy-capacity theorem; minimax redundancy; minimax regret; Jeffreys' prior; risk aversion; Renyi divergence; alpha-mutual information; DATA-COMPRESSION; RISK-AVERSION; INFORMATION; ASYMPTOTICS; STRATEGIES;

D O I：

10.1109/TIT.2018.2803070

中图分类号：

TP [自动化技术、计算机技术];

学科分类号：

0812 ;

摘要：

The redundancy for universal lossless compression of discrete memoryless sources in Campbell's setting is characterized as a minimax Renyi divergence, which is shown to be equal to the maximal alpha-mutual information via a generalized redundancy-capacity theorem. Special attention is placed on the analysis of the asymptotics of minimax Renyi divergence, which is determined up to a term vanishing in blocklength.

引用

页码：3715 / 3733

页数：19

共 50 条

[21] Asymmetric Renyi Problem
Drmota, M.
Magner, A.
Szpankowski, W.
COMBINATORICS PROBABILITY & COMPUTING, 2019, 28 (04) : 542 - 573
[22] Swiveled Renyi entropies
Dupuis, Frederic
Wilde, Mark M.
QUANTUM INFORMATION PROCESSING, 2016, 15 (03) : 1309 - 1345
[23] Sufficiency of Renyi Divergences
Galke, Niklas
van Luijk, Lauritz
Wilming, Henrik
IEEE TRANSACTIONS ON INFORMATION THEORY, 2024, 70 (07) : 5057 - 5076
[24] Renyi divergence measures for commonly used univariate continuous distributions
Gil, M.
Alajaji, F.
Linder, T.
INFORMATION SCIENCES, 2013, 249 : 124 - 131
[25] Arimoto-Renyi Conditional Entropy and Bayesian Hypothesis Testing
Sason, Igal
Verdu, Sergio
2017 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY (ISIT), 2017,
[26] MINIMAX ESTIMATION OF NONREGULAR PARAMETERS AND DISCONTINUITY IN MINIMAX RISK
Song, Kyungchul
ESSAYS IN HONOR OF PETER C. B. PHILLIPS, 2014, 33 : 557 - 585
[27] On the Renyi Divergence, Joint Range of Relative Entropies, and a Channel Coding Theorem
Sason, Igal
IEEE TRANSACTIONS ON INFORMATION THEORY, 2016, 62 (01) : 23 - 34
[28] Investigating equality: The Renyi spectrum
Eliazar, Iddo
PHYSICA A-STATISTICAL MECHANICS AND ITS APPLICATIONS, 2017, 481 : 90 - 118
[29] Bayesian Brains and the Renyi Divergence
Sajid, Noor
Faccio, Francesco
Da Costa, Lancelot
Parr, Thomas
Schmidhuber, Juergen
Friston, Karl
NEURAL COMPUTATION, 2022, 34 (04) : 829 - 855
[30] Renyi divergence on learning with errors
Tao, Yang
Wang, Han
Zhang, Rui
SCIENCE CHINA-INFORMATION SCIENCES, 2020, 63 (09)

← 1 2 3 4 5 →