Penalized Regression with Ordinal Predictors

被引:53
|
作者
Gertheiss, Jan [1 ]
Tutz, Gerhard [1 ]
机构
[1] Univ Munich, D-80799 Munich, Germany
关键词
Basis function approach; classical linear model; dummy coding; generalized linear models; generalized ridge regression; ordinal predictors; penalized likelihood estimation; RANK ORDER CATEGORIES; RIDGE-REGRESSION; MODELS; ASSIGNMENT; VARIABLES; NUMBERS;
D O I
10.1111/j.1751-5823.2009.00088.x
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
P>Ordered categorial predictors are a common case in regression modelling. In contrast to the case of ordinal response variables, ordinal predictors have been largely neglected in the literature. In this paper, existing methods are reviewed and the use of penalized regression techniques is proposed. Based on dummy coding two types of penalization are explicitly developed; the first imposes a difference penalty, the second is a ridge type refitting procedure. Also a Bayesian motivation is provided. The concept is generalized to the case of non-normal outcomes within the framework of generalized linear models by applying penalized likelihood estimation. Simulation studies and real world data serve for illustration and to compare the approaches to methods often seen in practice, namely simple linear regression on the group labels and pure dummy coding. Especially the proposed difference penalty turns out to be highly competitive.
引用
收藏
页码:345 / 365
页数:21
相关论文
共 50 条
  • [41] PENALIZED INTERACTION ESTIMATION FOR ULTRAHIGH DIMENSIONAL QUADRATIC REGRESSION
    Wang, Cheng
    Jiang, Binyan
    Zhu, Liping
    STATISTICA SINICA, 2021, 31 (03) : 1549 - 1570
  • [42] Efficient Implementation of Penalized Regression for Genetic Risk Prediction
    Prive, Florian
    Aschard, Hugues
    Blum, Michael G. B.
    GENETICS, 2019, 212 (01) : 65 - 74
  • [43] Recent Advances on Penalized Regression Models for Biological Data
    Wang, Pei
    Chen, Shunjie
    Yang, Sijia
    MATHEMATICS, 2022, 10 (19)
  • [44] A Unified Algorithm for Penalized Convolution Smoothed Quantile Regression
    Man, Rebeka
    Pan, Xiaoou
    Tan, Kean Ming
    Zhou, Wen-Xin
    JOURNAL OF COMPUTATIONAL AND GRAPHICAL STATISTICS, 2024, 33 (02) : 625 - 637
  • [45] Robust penalized logistic regression with truncated loss functions
    Park, Seo Young
    Liu, Yufeng
    CANADIAN JOURNAL OF STATISTICS-REVUE CANADIENNE DE STATISTIQUE, 2011, 39 (02): : 300 - 323
  • [46] Reproducing Kernel Hilbert Spaces for Penalized Regression: A Tutorial
    Nosedal-Sanchez, Alvaro
    Storlie, Curtis B.
    Lee, Thomas C. M.
    Christensen, Ronald
    AMERICAN STATISTICIAN, 2012, 66 (01) : 50 - 60
  • [47] LASSO type penalized spline regression for binary data
    Mullah, Muhammad Abu Shadeque
    Hanley, James A.
    Benedetti, Andrea
    BMC MEDICAL RESEARCH METHODOLOGY, 2021, 21 (01)
  • [48] Locally and globally robust Penalized Trimmed Squares regression
    Avramidis, A.
    Zioutas, G.
    SIMULATION MODELLING PRACTICE AND THEORY, 2011, 19 (01) : 148 - 160
  • [49] Cross-validation approaches for penalized Cox regression
    Dai, Biyue
    Breheny, Patrick
    STATISTICAL METHODS IN MEDICAL RESEARCH, 2024, 33 (04) : 702 - 715
  • [50] Robust penalized quantile regression estimation for panel data
    Lamarche, Carlos
    JOURNAL OF ECONOMETRICS, 2010, 157 (02) : 396 - 408