The Sampling Distribution of the Total Correlation for Multivariate Gaussian Random Variables

被引:2
作者
Rowe, Taylor [1 ]
Day, Troy [1 ]
机构
[1] Queens Univ, Dept Math & Stat, Kingston, ON K7L 3N6, Canada
基金
加拿大自然科学与工程研究理事会;
关键词
mutual information; total correlation; multiinformation; sampling distribution; central limit theorem; multivariate mutual information; INFORMATION; ENTROPY;
D O I
10.3390/e21100921
中图分类号
O4 [物理学];
学科分类号
0702 ;
摘要
The sampling distribution of the total correlation (TC) for a d-dimensional standardized multivariate Gaussian random variable with an identity covariance matrix is derived. It is shown to be the distribution of a sum of generalized beta random variables. It is also shown that, for large dimension and sample size, a central limit theorem holds, providing a Gaussian approximation to the sampling distribution for high dimensional data.
引用
收藏
页数:8
相关论文
共 20 条
[1]  
ANDERSON T. W., 2003, INTRO MULTIVARIATE S, VSecond
[2]  
[Anonymous], 2012, ELEMENTS INFORM THEO
[3]  
[Anonymous], 1968, INFORM THEORY STAT
[4]  
[Anonymous], 1964, The Mathematical Theory of Communication
[5]  
[Anonymous], 1962, Uncertainty and structure as psychological concepts
[6]   The logarithmic law of random determinant [J].
Bao, Zhigang ;
Pan, Guangming ;
Zhou, Wang .
BERNOULLI, 2015, 21 (03) :1600-1628
[7]  
Billiingsley P., 1995, PROBABILITY MEASURE
[8]   Law of log determinant of sample covariance matrix and optimal estimation of differential entropy for high-dimensional Gaussian distributions [J].
Cai, T. Tony ;
Liang, Tengyuan ;
Zhou, Harrison H. .
JOURNAL OF MULTIVARIATE ANALYSIS, 2015, 137 :161-172
[9]   A refinement of the central limit theorem for random determinants [J].
Girko, VL .
THEORY OF PROBABILITY AND ITS APPLICATIONS, 1998, 42 (01) :121-129
[10]   DISTRIBUTION OF DETERMINANT OF A COMPLEX WISHART DISTRIBUTED MATRIX [J].
GOODMAN, NR .
ANNALS OF MATHEMATICAL STATISTICS, 1963, 34 (01) :178-&