THE UPWARD BIAS IN MEASURES OF INFORMATION DERIVED FROM LIMITED DATA SAMPLES

被引:262
作者
TREVES, A [1 ]
PANZERI, S [1 ]
机构
[1] SISSA,BIOPHYS & MATH PHYS,I-34013 TRIESTE,ITALY
关键词
D O I
10.1162/neco.1995.7.2.399
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Extracting information measures from limited experimental samples, such as those normally available when using data recorded in vivo from mammalian cortical neurons, is known to be plagued by a systematic error, which tends to bias the estimate upward. We calculate here the average of the bias, under certain conditions, as an asymptotic expansion in the inverse of the size of the data sample. The result agrees with numerical simulations, and is applicable, as an additive correction term, to measurements obtained under such conditions. Moreover, we discuss the implications for measurements obtained through other usual procedures.
引用
收藏
页码:399 / 407
页数:9
相关论文
共 11 条
[1]   ON BIAS OF INFORMATION ESTIMATES [J].
CARLTON, AG .
PSYCHOLOGICAL BULLETIN, 1969, 71 (02) :108-&
[2]   CLUSTER METHOD FOR ANALYSIS OF TRANSMITTED INFORMATION IN MULTIVARIATE NEURONAL DATA [J].
CHEEORTS, MN ;
OPTICAN, LM .
BIOLOGICAL CYBERNETICS, 1993, 69 (01) :29-35
[3]   DIVERGENCE OF PERTURBATION THEORY IN QUANTUM ELECTRODYNAMICS [J].
DYSON, FJ .
PHYSICAL REVIEW, 1952, 85 (04) :631-632
[4]   RIGOROUS AND EXTENDED APPLICATION OF INFORMATION-THEORY TO AFFERENT VISUAL SYSTEM OF CAT .2. EXPERIMENTAL RESULTS [J].
ECKHORN, R ;
POPEL, B .
BIOLOGICAL CYBERNETICS, 1975, 17 (01) :7-17
[5]   THEORY OF SPIN GLASSES [J].
EDWARDS, SF ;
ANDERSON, PW .
JOURNAL OF PHYSICS F-METAL PHYSICS, 1975, 5 (05) :965-974
[6]  
HERTZ JA, 1992, INT J NEURAL SYST S, V3, P91
[7]  
Kjaer T W, 1994, J Comput Neurosci, V1, P109, DOI 10.1007/BF00962721
[8]  
MILLER GA, 1969, INFORMATION THEORY B, V11, P95
[9]   UNIBIASED MEASURES OF TRANSMITTED INFORMATION AND CHANNEL CAPACITY FROM MULTIVARIATE NEURONAL DATA [J].
OPTICAN, LM ;
GAWNE, TJ ;
RICHMOND, BJ ;
JOSEPH, PJ .
BIOLOGICAL CYBERNETICS, 1991, 65 (05) :305-310
[10]   TEMPORAL ENCODING OF TWO-DIMENSIONAL PATTERNS BY SINGLE UNITS IN PRIMATE INFERIOR TEMPORAL CORTEX .3. INFORMATION THEORETIC ANALYSIS [J].
OPTICAN, LM ;
RICHMOND, BJ .
JOURNAL OF NEUROPHYSIOLOGY, 1987, 57 (01) :162-178