Testing the order of a model

被引:12
作者
Chambaz, Antoine [1 ]
机构
[1] Univ Paris 05, CNRS, MAPS, UMR 8145, F-75270 Paris 06, France
关键词
abrupt changes; empirical processes; error exponents; hypothesis testing; large deviations; mixtures; model selection; moderate deviations; order estimation;
D O I
10.1214/009053606000000344
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
This paper deals with order identification for nested models in the i.i.d. framework. We study the asymptotic efficiency of two generalized likelihood ratio tests of the order. They are based on two estimators which are proved to be strongly consistent. A version of Stein's lemma yields an optimal underestimation error exponent. The lemma also implies that the overestimation error exponent is necessarily trivial. Our tests admit nontrivial underestimation error exponents. The optimal underestimation error exponent is achieved in some situations. The overestimation error can decay exponentially with respect to a positive power of the number of observations. These results are proved under mild assumptions by relating the underestimation (resp. overestimation) error to large (resp. moderate) deviations of the log-likelihood process. In particular, it is not necessary that the classical Cramer condition be satisfied; namely, the log-densities are not required to admit every exponential moment. Three benchmark examples with specific difficulties (location mixture of normal distributions, abrupt changes and various regressions) are detailed so as to illustrate the generality of our results.
引用
收藏
页码:1166 / 1203
页数:38
相关论文
共 44 条
  • [1] NEW LOOK AT STATISTICAL-MODEL IDENTIFICATION
    AKAIKE, H
    [J]. IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 1974, AC19 (06) : 716 - 723
  • [2] [Anonymous], [No title captured]
  • [3] Azencott R., 1986, SERIES IRREGULAR OBS
  • [4] Bahadur R. R., 1965, P 5 BERK S MATH STAT, V1, P13
  • [5] Bahadur R. R., 1980, ASYMPTOTIC THEORY ST, P33
  • [6] BAHADUR R. R, 1971, SOME LIMIT THEOREMS
  • [7] Risk bounds for model selection via penalization
    Barron, A
    Birgé, L
    Massart, P
    [J]. PROBABILITY THEORY AND RELATED FIELDS, 1999, 113 (03) : 301 - 413
  • [8] Error exponents for AR order testing
    Boucheron, S
    Gassiat, E
    [J]. IEEE TRANSACTIONS ON INFORMATION THEORY, 2006, 52 (02) : 472 - 488
  • [9] BOUCHERON S, 2005, INFERENCE HIDDEN MAR, P565
  • [10] Cencov NN., 2000, Statistical decision rules and optimal inference, DOI [10.1090/mmono/053, DOI 10.1090/MMONO/053]