On Information, Estimation and Lookahead

被引:0
作者
Venkat, Kartik [1 ]
Weissman, Tsachy [1 ]
Carmon, Yair [2 ]
Shamai, Shlomo [2 ]
机构
[1] Stanford Univ, Stanford, CA 94305 USA
[2] Technion-IIT, EE, Haifa, Israel
来源
2012 50TH ANNUAL ALLERTON CONFERENCE ON COMMUNICATION, CONTROL, AND COMPUTING (ALLERTON) | 2012年
基金
美国国家科学基金会; 以色列科学基金会;
关键词
MUTUAL INFORMATION; CHANNELS;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
We consider mean squared estimation with lookahead of a continuous-time signal corrupted by additive white Gaussian noise. We investigate the connections between lookahead in estimation, and information under this model. We show that the mutual information rate function, i.e., the mutual information rate as function of the signal-to-noise ratio (SNR) does not in general determine the mean squared error with fixed finite lookahead, in contrast to the special cases with 0 and infinite lookahead (filtering and smoothing errors), respectively, which were previously established in the literature. Independently, we define the notion of information utility of finite lookahead, and characterize properties of the same. We also establish a new expectation identity under a generalized observation model (where the Gaussian channel has an SNR jump at t = 0), capturing the tradeoff between lookahead and SNR.
引用
收藏
页码:1292 / 1299
页数:8
相关论文
共 7 条
[1]   ON CALCULATION OF MUTUAL INFORMATION [J].
DUNCAN, TE .
SIAM JOURNAL ON APPLIED MATHEMATICS, 1970, 19 (01) :215-&
[2]   Mutual information and minimum mean-square error in Gaussian channels [J].
Guo, DN ;
Shamai, S ;
Verdú, S .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2005, 51 (04) :1261-1282
[3]  
Karatzas I., 1988, Graduate text in mathematics
[4]   Pointwise Relations Between Information and Estimation in Gaussian Noise [J].
Venkat, Kartik ;
Weissman, Tsachy .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2012, 58 (10) :6264-6281
[5]   Mismatched Estimation and Relative Entropy [J].
Verdu, Sergio .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2010, 57 (08) :3712-3720
[6]   The Relationship Between Causal and Noncausal Mismatched Estimation in Continuous-Time AWGN Channels [J].
Weissman, Tsachy .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2010, 56 (09) :4256-4273
[7]   On mutual information, likelihood ratios, and estimation error for the additive Gaussian channel [J].
Zakai, M .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2005, 51 (09) :3017-3024