Differentiating information transfer and causal effect

被引:157
作者
Lizier, J. T. [1 ,2 ]
Prokopenko, M. [1 ,3 ]
机构
[1] Informat & Commun Technol Ctr, CSIRO, N Ryde, NSW 1670, Australia
[2] Univ Sydney, Sch Informat Technol, Sydney, NSW 2006, Australia
[3] Max Planck Inst Math Sci, D-04103 Leipzig, Germany
关键词
Cellular Automaton; Information Transfer; Transfer Entropy; Causal Information; Conditional Mutual Information;
D O I
10.1140/epjb/e2010-00034-5
中图分类号
O469 [凝聚态物理学];
学科分类号
070205 ;
摘要
The concepts of information transfer and causal effect have received much recent attention, yet often the two are not appropriately distinguished and certain measures have been suggested to be suitable for both. We discuss two existing measures, transfer entropy and information flow, which can be used separately to quantify information transfer and causal information flow respectively. We apply these measures to cellular automata on a local scale in space and time, in order to explicitly contrast them and emphasize the differences between information transfer and causality. We also describe the manner in which the measures are complementary, including the conditions under which they in fact converge. We show that causal information flow is a primary tool to describe the causal structure of a system, while information transfer can then be used to describe the emergent computation on that causal structure.
引用
收藏
页码:605 / 615
页数:11
相关论文
共 33 条
[1]  
[Anonymous], 2002, A New Kind of Science
[2]  
[Anonymous], FRAMEWORK LOCAL INFO
[3]   Top-down causation by information control: from a philosophical problem to a scientific research programme [J].
Auletta, G. ;
Ellis, G. F. R. ;
Jaeger, L. .
JOURNAL OF THE ROYAL SOCIETY INTERFACE, 2008, 5 (27) :1159-1172
[4]   Information flows in causal networks [J].
Ay, Nihat ;
Polani, Daniel .
ADVANCES IN COMPLEX SYSTEMS, 2008, 11 (01) :17-41
[5]   How to measure the information gained from one symbol [J].
DeWeese, MR ;
Meister, M .
NETWORK-COMPUTATION IN NEURAL SYSTEMS, 1999, 10 (04) :325-340
[6]   INVESTIGATING CAUSAL RELATIONS BY ECONOMETRIC MODELS AND CROSS-SPECTRAL METHODS [J].
GRANGER, CWJ .
ECONOMETRICA, 1969, 37 (03) :424-438
[7]   THE ATTRACTOR-BASIN PORTRAIT OF A CELLULAR AUTOMATON [J].
HANSON, JE ;
CRUTCHFIELD, JP .
JOURNAL OF STATISTICAL PHYSICS, 1992, 66 (5-6) :1415-1462
[8]   Computational mechanics of cellular automata: An example [J].
Hanson, JE ;
Crutchfield, JP .
PHYSICA D, 1997, 103 (1-4) :169-189
[9]  
Helvik T, 2004, LECT NOTES COMPUT SC, V3305, P121
[10]   Continuity of information transport in surjective cellular automata [J].
Helvik, Torbjorn ;
Lindgren, Kristian ;
Nordahl, Mats G. .
COMMUNICATIONS IN MATHEMATICAL PHYSICS, 2007, 272 (01) :53-74