Adaptive conditional feature screening

被引:13
作者
Lin, Lu [1 ]
Sun, Jing [2 ]
机构
[1] Shandong Univ, Qilu Secur Inst Financial Studies, Jinan 250100, Peoples R China
[2] Ludong Univ, Sch Math & Stat Sci, Yantai, Peoples R China
关键词
High-dimensional data; Model free; Conditional feature screening; Adaptability; Marginal utility; VARIABLE SELECTION; DIMENSIONAL DATA; MODELS; SURVIVAL;
D O I
10.1016/j.csda.2015.09.002
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
When the correlation among the predictors is relatively strong and/or the model structures cannot be specified, the construction of adaptive feature screening remains a challenging issue. A general technique of conditional feature screening is proposed via combining a model-free feature screening with a predetermined set of predictors. The proposed centralization technique can remove the irrelevant part from the criterion of the model-free feature screening. Consequently, the new criterion can measure the marginal utilities of predictors conditional on the predetermined set of predictors. The conditional information about these predetermined predictors helps reducing the correlation among covariates and as a result the resulting method can reduce the false positive and the false negative rates in the variable selection procedure. Thus, our method is adaptive to both the correlation among the covariates and the model misspecification. The new procedures are computationally efficient and simple, and can be extended to other relevant methods. (C) 2015 Elsevier B.V. All rights reserved.
引用
收藏
页码:287 / 301
页数:15
相关论文
共 17 条
  • [1] Barut E., 2012, CONDITIONAL SU UNPUB
  • [2] Chang J., 2013, ANN STAT, V41, P1693
  • [3] High dimensional variable selection via tilting
    Cho, Haeran
    Fryzlewicz, Piotr
    [J]. JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-STATISTICAL METHODOLOGY, 2012, 74 : 593 - 622
  • [4] Sure independence screening for ultrahigh dimensional feature space
    Fan, Jianqing
    Lv, Jinchi
    [J]. JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-STATISTICAL METHODOLOGY, 2008, 70 : 849 - 883
  • [5] Nonparametric Independence Screening in Sparse Ultra-High-Dimensional Additive Models
    Fan, Jianqing
    Feng, Yang
    Song, Rui
    [J]. JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2011, 106 (494) : 544 - 557
  • [6] SURE INDEPENDENCE SCREENING IN GENERALIZED LINEAR MODELS WITH NP-DIMENSIONALITY
    Fan, Jianqing
    Song, Rui
    [J]. ANNALS OF STATISTICS, 2010, 38 (06) : 3567 - 3604
  • [7] ON ALMOST LINEARITY OF LOW-DIMENSIONAL PROJECTIONS FROM HIGH-DIMENSIONAL DATA
    HALL, P
    LI, KC
    [J]. ANNALS OF STATISTICS, 1993, 21 (02) : 867 - 889
  • [8] QUANTILE-ADAPTIVE MODEL-FREE VARIABLE SCREENING FOR HIGH-DIMENSIONAL HETEROGENEOUS DATA
    He, Xuming
    Wang, Lan
    Hong, Hyokyoung Grace
    [J]. ANNALS OF STATISTICS, 2013, 41 (01) : 342 - 369
  • [9] ROBUST RANK CORRELATION BASED SCREENING
    Li, Gaorong
    Peng, Heng
    Zhang, Jun
    Zhu, Lixing
    [J]. ANNALS OF STATISTICS, 2012, 40 (03) : 1846 - 1877
  • [10] Nonparametric feature screening
    Lin, Lu
    Sun, Jing
    Zhu, Lixing
    [J]. COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2013, 67 : 162 - 174