Approximating conditional distribution functions using dimension reduction

被引:45
作者
Hall, P [1 ]
Yao, QW
机构
[1] Australian Natl Univ, Ctr Math & Applicat, Canberra, ACT 0200, Australia
[2] London Sch Econ, Dept Stat, London WC1A 2AE, England
基金
英国工程与自然科学研究理事会;
关键词
conditional distribution; cross-validation; dimension reduction; kernel methods; leave-one-out method; local linear regression; nonparametric regression; prediction; root-n consistency; time series analysis;
D O I
10.1214/009053604000001282
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
Motivated by applications to prediction and forecasting, we suggest methods for approximating the conditional distribution function of a random variable Y given a dependent random d-vector X. The idea is to estimate not the distribution of Y vertical bar X, but that of Y vertical bar theta(T)X' where the unit vector theta is selected so that the approximation is optimal under a least-squares criterion. We show that theta may be estimated root-n consistently, Furthermore, estimation of the conditional distribution function of Y, given theta(T)X, has the same first-order asymptotic properties that it would enjoy if theta were known. The proposed method is illustrated using both simulated and real-data examples, showing its effectiveness for both independent datasets and data from time series. Numerical work corroborates the theoretical result that theta can be estimated particularly accurately.
引用
收藏
页码:1404 / 1421
页数:18
相关论文
共 32 条
[1]   Conditional distribution learning with neural networks and its application to channel equalization [J].
Adali, T ;
Liu, X ;
Sonmez, MK .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 1997, 45 (04) :1051-1064
[2]   Bandwidth selection for kernel conditional density estimation [J].
Bashtannyk, DM ;
Hyndman, RJ .
COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2001, 36 (03) :279-298
[3]   KERNEL AND NEAREST-NEIGHBOR ESTIMATION OF A CONDITIONAL QUANTILE [J].
BHATTACHARYA, PK ;
GANGOPADHYAY, AK .
ANNALS OF STATISTICS, 1990, 18 (03) :1400-1415
[4]  
BOND SA, 2000, CONDITIONAL DISTRIBU
[5]   Regression quantiles for time series [J].
Cai, ZW .
ECONOMETRIC THEORY, 2002, 18 (01) :169-192
[6]  
Fan J., 2003, NONLINEAR TIME SERIE
[7]   Estimation of conditional densities and sensitivity measures in nonlinear dynamical systems [J].
Fan, JQ ;
Yao, QW ;
Tong, H .
BIOMETRIKA, 1996, 83 (01) :189-206
[8]   LOCAL POLYNOMIAL KERNEL REGRESSION FOR GENERALIZED LINEAR-MODELS AND QUASI-LIKELIHOOD FUNCTIONS [J].
FAN, JQ ;
HECKMAN, NE ;
WAND, MP .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 1995, 90 (429) :141-150
[9]  
FORESI S, 1992, 9249 C V STARR CTR N
[10]   EXPLORATORY PROJECTION PURSUIT [J].
FRIEDMAN, JH .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 1987, 82 (397) :249-266