Nonanticipative Rate Distortion Function and Relations to Filtering Theory

被引:39
作者
Charalambous, Charalambos D. [1 ]
Stavrou, Photios A. [1 ]
Ahmed, Nasir U. [2 ]
机构
[1] Univ Cyprus, Dept Elect & Comp Engn, CY-1678 Nicosia, Cyprus
[2] Univ Ottawa, Sch Elect Engn & Comp Sci, Ottawa, ON K1N 6N5, Canada
关键词
Filtering; nonanticipative rate distortion function (RDF); optimal reconstruction conditional distribution; realization; weak(star)-convergence; STOCHASTIC-SYSTEMS; STATE ESTIMATION; INFORMATION;
D O I
10.1109/TAC.2013.2293403
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The relation between nonanticipative rate distortion function (RDF) and filtering theory is discussed on abstract spaces. The relation is established by imposing a realizability constraint on the reconstruction conditional distribution of the classical RDF. Existence of the extremum solution of the nonanticipative RDF is shown using weak*-convergence on appropriate topology. The extremum reconstruction conditional distribution is derived in closed form, for the case of stationary processes. The realization of the reconstruction conditional distribution which achieves the infimum of the nonanticipative RDF is described. Finally, an example is presented to illustrate the concepts.
引用
收藏
页码:937 / 952
页数:16
相关论文
共 37 条
[1]  
[Anonymous], 2006, Elements of Information Theory
[2]  
[Anonymous], 2000, THESIS MASSACHUSETTS
[3]  
[Anonymous], 1995, Hidden Markov Models: Estimation and Control
[4]  
BERGER T, 1971, RATE DISTORATION THE
[5]  
Borkar Vivek S, 2001, Communications in Information and Systems, V1, P15
[6]   DISTORTION RATE THEORY AND FILTERING [J].
BUCY, RS .
IEEE TRANSACTIONS ON INFORMATION THEORY, 1982, 28 (02) :336-340
[7]  
Caines P. E., 1988, WILEY SERIES PROBABI
[8]   Stochastic uncertain systems subject to relative entropy constraints: Induced norms and monotonicity properties of minimax games [J].
Charalambous, Charalambos D. ;
Rezaei, Farzad .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2007, 52 (04) :647-663
[9]   LQG optimality and separation principle for general discrete time partially observed stochastic systems over finite capacity communication channels [J].
Charalambous, Charalambos D. ;
Farhadi, Alireza .
AUTOMATICA, 2008, 44 (12) :3181-3188
[10]  
Csiszar I., 1974, STUD SCI MATH HUNG, V9, P57