Mutual information and conditional mean estimation in Poisson channels

被引:77
作者
Guo, Dongning [1 ]
Shamai, Shlomo [2 ]
Verdu, Sergio [3 ]
机构
[1] Northwestern Univ, Dept Elect Engn & Comp Sci, Evanston, IL 60208 USA
[2] Technion Israel Inst Technol, Dept Elect Engn, IL-32000 Haifa, Israel
[3] Princeton Univ, Dept Elect Engn, Princeton, NJ 08544 USA
基金
美国国家科学基金会;
关键词
mutual information; nonlinear filtering; optimal estimation; point process; Poisson process; smoothing;
D O I
10.1109/TIT.2008.920206
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Following the discovery of a fundamental connection between information measures and estimation measures in Gaussian channels, this paper explores the counterpart of those results in Poisson channels. In the continuous-time setting, the received signal is a doubly stochastic Poisson point process whose rate is equal to the input signal plus a dark current. It is found that, regardless of the statistics of the input, the derivative of the input-output mutual information with respect to the intensity of the additive dark current can be expressed as the expected difference between the logarithm of the input and the logarithm of its noncausal conditional mean estimate. The same holds for the derivative with respect to input scaling, but with the logarithmic function replaced by x log x. Similar relationships hold for discrete-time versions of the channel where the outputs are Poisson random variables conditioned on the input symbols.
引用
收藏
页码:1837 / 1849
页数:13
相关论文
共 38 条
[1]  
[Anonymous], 2006, Elements of information theory
[2]  
[Anonymous], 1990, P I ELECTR ENG
[3]  
[Anonymous], 1988, Real analysis
[4]   COMMUNICATION UNDER POISSON REGIME [J].
BARDAVID, I .
IEEE TRANSACTIONS ON INFORMATION THEORY, 1969, 15 (1P1) :31-+
[5]  
Bedekar A. S., 2001, Proceedings. 2001 IEEE International Symposium on Information Theory (IEEE Cat. No.01CH37252), DOI 10.1109/ISIT.2001.936090
[6]  
Bertoin J., 1996, Levy Processes
[7]   RECURSIVE NON-LINEAR ESTIMATION OF A DIFFUSION ACTING AS THE RATE OF AN OBSERVED POISSON-PROCESS [J].
BOEL, RK ;
BENES, VE .
IEEE TRANSACTIONS ON INFORMATION THEORY, 1980, 26 (05) :561-575
[8]  
Bremaud P., 1981, Point Processes and Queues: Martingale Dynamics
[9]   Capacity and decoding rules for the Poisson arbitrarily varying channel [J].
Bross, SI ;
Shamai, S .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2003, 49 (11) :3076-3093
[10]   The Poisson fading channel [J].
Chakraborty, Kaushik ;
Narayan, Prakash .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2007, 53 (07) :2349-2364