A general approach to heteroscedastic linear regression

被引:0
作者
David S. Leslie
Robert Kohn
David J. Nott
机构
[1] University of Bristol,Department of Mathematics
[2] University Walk,School of Mathematics
[3] Faculty of Business,undefined
[4] University of New South Wales,undefined
[5] UNSW,undefined
[6] University of New South Wales,undefined
[7] UNSW,undefined
来源
Statistics and Computing | 2007年 / 17卷
关键词
Density estimation; Dirichlet process mixture; Heteroscedasticity; Model checking; Nonparametric regression; Variable selection;
D O I
暂无
中图分类号
学科分类号
摘要
Our article presents a general treatment of the linear regression model, in which the error distribution is modelled nonparametrically and the error variances may be heteroscedastic, thus eliminating the need to transform the dependent variable in many data sets. The mean and variance components of the model may be either parametric or nonparametric, with parsimony achieved through variable selection and model averaging. A Bayesian approach is used for inference with priors that are data-based so that estimation can be carried out automatically with minimal input by the user. A Dirichlet process mixture prior is used to model the error distribution nonparametrically; when there are no regressors in the model, the method reduces to Bayesian density estimation, and we show that in this case the estimator compares favourably with a well-regarded plug-in density estimator. We also consider a method for checking the fit of the full model. The methodology is applied to a number of simulated and real examples and is shown to work well.
引用
收藏
页码:131 / 146
页数:15
相关论文
共 47 条
[1]  
Antoniak C.E(1974)Mixtures of Dirichlet processes with applications to Bayesian nonparametric problems The Annals of Statistics 2 1152-1174
[2]  
Bartels R.(1996)Gas or electricity, which is cheaper?: An econometric approach with application to Australian expenditure data The Energy Journal 17 33-58
[3]  
Fiebig D.G(1998)General methods for monitoring convergence of iterative simulations Journal of Computational and Graphical Statistics 7 434-455
[4]  
Plumb M.H(2005)Locally adaptive semiparametric estimation of the mean and variance functions in regression models Forthcoming in Journal of Computational and Graphical Statistics 15 915-936
[5]  
Brooks S.P(2006)Bayesian subset selection and model averaging using a centred and dispersed prior for the error variance Australian and New Zealand Journal of Statistics 48 237-252
[6]  
Gelman A.(1995)Bayesian density estimation and inference using mixtures Journal of the American Statistical Association 90 577-588
[7]  
Chan D.(1973)A Bayesian analysis of some nonparametric problems The Annals of Statistics 1 209-230
[8]  
Kohn R.(1997)Sampling from the posterior distribution in generalized linear mixed models Statistics and Computing 7 57-68
[9]  
Nott D.J.(2001)Modelling heterogeneity with and without the Dirichlet process Scandinavian Journal of Statistics 28 355-375
[10]  
Kirby C.(2002)Modeling regression error with a mixture of Polya trees Journal of the American Statistical Association 97 1020-1033