Minimax Renyi Redundancy

被引：4

作者：

Yagli, Semih ^{[1
]}

Altug, Yucel ^{[2
]}

Verdu, Sergio ^{[1
]}

机构：

[1] Princeton Univ, Dept Elect Engn, Princeton, NJ 08544 USA

[2] Natera Inc, San Carlos, CA 94070 USA

来源：

IEEE TRANSACTIONS ON INFORMATION THEORY | 2018年 / 64卷 / 05期

基金：

美国国家科学基金会;

关键词：

Universal lossless compression; generalized redundancy-capacity theorem; minimax redundancy; minimax regret; Jeffreys' prior; risk aversion; Renyi divergence; alpha-mutual information; DATA-COMPRESSION; RISK-AVERSION; INFORMATION; ASYMPTOTICS; STRATEGIES;

D O I：

10.1109/TIT.2018.2803070

中图分类号：

TP [自动化技术、计算机技术];

学科分类号：

0812 ;

摘要：

The redundancy for universal lossless compression of discrete memoryless sources in Campbell's setting is characterized as a minimax Renyi divergence, which is shown to be equal to the maximal alpha-mutual information via a generalized redundancy-capacity theorem. Special attention is placed on the analysis of the asymptotics of minimax Renyi divergence, which is determined up to a term vanishing in blocklength.

引用

页码：3715 / 3733

页数：19

共 50 条

[41] Improved Bounds on Lossless Source Coding and Guessing Moments via Renyi Measures
Sason, Igal
Verdu, Sergio
IEEE TRANSACTIONS ON INFORMATION THEORY, 2018, 64 (06) : 4323 - 4346
[42] Minimax and the value of information
Sadler, Evan
THEORY AND DECISION, 2015, 78 (04) : 575 - 586
[43] On the Renyi Differential Privacy of the Shuffle Model
Girgis, Antonious M.
Data, Deepesh
Diggavi, Suhas
Suresh, Ananda Theertha
Kairouz, Peter
CCS '21: PROCEEDINGS OF THE 2021 ACM SIGSAC CONFERENCE ON COMPUTER AND COMMUNICATIONS SECURITY, 2021, : 2321 - 2341
[44] Geometry Induced by a Generalization of Renyi Divergence
de Souza, David C.
Vigelis, Rui F.
Cavalcante, Charles C.
ENTROPY, 2016, 18 (11):
[45] On the minimax spherical designs
Fu, Weibo
Wang, Guanyang
Yan, Jun
RANDOM STRUCTURES & ALGORITHMS, 2023, 62 (01) : 131 - 154
[46] Conditions for the existence of a generalization of Renyi divergence
Vigelis, Rui F.
de Andrade, Luiza H. F.
Cavalcante, Charles C.
PHYSICA A-STATISTICAL MECHANICS AND ITS APPLICATIONS, 2020, 558
[47] Renyi entropy rate for Gaussian processes
Golshani, Leila
Pasha, Einollah
INFORMATION SCIENCES, 2010, 180 (08) : 1486 - 1491
[48] Estimating Renyi Entropy of Discrete Distributions
Acharya, Jayadev
Orlitsky, Alon
Suresh, Ananda Theertha
Tyagi, Himanshu
IEEE TRANSACTIONS ON INFORMATION THEORY, 2017, 63 (01) : 38 - 56
[49] Global Renyi index of the distance matrix
Nie, Chun-Xiao
Song, Fu-Tie
PHYSICA A-STATISTICAL MECHANICS AND ITS APPLICATIONS, 2019, 514 : 902 - 915
[50] α-z-Renyi relative entropies
Audenaert, Koenraad M. R.
Datta, Nilanjana
JOURNAL OF MATHEMATICAL PHYSICS, 2015, 56 (02)

← 1 2 3 4 5 →