Kullback-Leibler Information of the Equilibrium Distribution Function and its Application to Goodness of Fit Test

被引:8
作者
Park, Sangun [1 ]
Choi, Dongseok [2 ]
Jung, Sangah [1 ]
机构
[1] Yonsei Univ, Dept Appl Stat, Shinchon Dong 134, Seoul 120749, South Korea
[2] Oregon Hlth & Sci Univ, Seoul, South Korea
基金
新加坡国家研究基金会;
关键词
Cumulative residual KL information; exponential distribution; Fisher information; Good-ness of fit test;
D O I
10.5351/CSAM.2014.21.2.125
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
Kullback-Leibler (KL) information is a measure of discrepancy between two probability density functions. However, several nonparametric density function estimators have been considered in estimating KL information because KL information is not well-defined on the empirical distribution function. In this paper, we consider the KL information of the equilibrium distribution function, which is well defined on the empirical distribution function (EDF), and propose an EDF-based goodness of fit test statistic. We evaluate the performance of the proposed test statistic for an exponential distribution with Monte Carlo simulation. We also extend the discussion to the censored case.
引用
收藏
页码:125 / 134
页数:10
相关论文
共 20 条
[11]   Relativistic equilibrium distribution by relative entropy maximization [J].
Nakamura, T. K. .
EPL, 2009, 88 (04)
[12]   The entropy of consecutive order statistics [J].
Park, S .
IEEE TRANSACTIONS ON INFORMATION THEORY, 1995, 41 (06) :2003-2007
[13]   Correcting moments for goodness of fit tests based on two entropy estimates [J].
Park, S ;
Park, D .
JOURNAL OF STATISTICAL COMPUTATION AND SIMULATION, 2003, 73 (09) :685-694
[14]   Testing exponentiality based on the Kullback-Leibler information with the type II censored data [J].
Park, SG .
IEEE TRANSACTIONS ON RELIABILITY, 2005, 54 (01) :22-26
[15]   Cumulative residual entropy: A new measure of information [J].
Rao, M ;
Chen, YM ;
Vemuri, BC ;
Wang, F .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2004, 50 (06) :1220-1228
[16]   THE SHAPIRO-WILK TEST FOR EXPONENTIALITY BASED ON CENSORED-DATA [J].
SAMANTA, M ;
SCHWARZ, CJ .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 1988, 83 (402) :528-531
[17]   Principal information theoretic approaches [J].
Soofi, ES .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2000, 95 (452) :1349-1353
[18]   GENERALIZATION OF GAMMA DISTRIBUTION [J].
STACY, EW .
ANNALS OF MATHEMATICAL STATISTICS, 1962, 33 (03) :1187-&
[19]   THE ENTROPY OF THE MAXIMUM-ENTROPY DISTRIBUTION [J].
THEIL, H .
ECONOMICS LETTERS, 1980, 5 (02) :145-148
[20]   THE ENTROPY OF ORDERED SEQUENCES AND ORDER-STATISTICS [J].
WONG, KM ;
CHEN, S .
IEEE TRANSACTIONS ON INFORMATION THEORY, 1990, 36 (02) :276-284