Model-free conditional screening via conditional distance correlation

被引:19
作者
Lu, Jun [1 ]
Lin, Lu [1 ,2 ]
机构
[1] Shandong Univ, Zhongtai Secur Inst Financial Studies, Jinan 250100, Peoples R China
[2] Qufu Normal Univ, Sch Stat, Qufu 273165, Shandong, Peoples R China
关键词
Ultrahigh dimensionality; Model free; Conditional distance correlation; Sure screening; VARIABLE SELECTION; LIKELIHOOD; REGRESSION; LASSO;
D O I
10.1007/s00362-017-0931-7
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
With the knowledge on the predetermined active predictors, we develop a feature screening procedure via the conditional distance correlation learning. The proposed procedure can significantly lower the correlation among the predictors when they are highly correlated and thus reduce the numbers of false positive and false negative. Meanwhile, when the conditional set is unable to be accessed beforehand, a data-driven method is provided to select it. We establish both the ranking consistency and the sure screening property for the new proposed procedure. To compare the performance of our method with its competitors, extensive simulations are conducted, which shows that the new procedure performs well in both the linear and nonlinear models. Finally, a real data analysis is investigated to further illustrate the effectiveness of the new method.
引用
收藏
页码:225 / 244
页数:20
相关论文
共 50 条
  • [31] Model-Free Feature Screening for Ultrahigh-Dimensional Data
    Zhu, Li-Ping
    Li, Lexin
    Li, Runze
    Zhu, Li-Xing
    JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2011, 106 (496) : 1464 - 1475
  • [32] Adaptive conditional feature screening
    Lin, Lu
    Sun, Jing
    COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2016, 94 : 287 - 301
  • [33] Model-free slice screening for ultrahigh-dimensional survival data
    Zhang, Jing
    Liu, Yanyan
    JOURNAL OF APPLIED STATISTICS, 2021, 48 (10) : 1755 - 1774
  • [34] Model-free feature screening for ultrahigh dimensional classification
    Sheng, Ying
    Wang, Qihua
    JOURNAL OF MULTIVARIATE ANALYSIS, 2020, 178
  • [35] The conditional distance autocovariance function
    Zhang, Qiang
    Pan, Wenliang
    Li, Chengwei
    Wang, Xueqin
    CANADIAN JOURNAL OF STATISTICS-REVUE CANADIENNE DE STATISTIQUE, 2021, 49 (04): : 1093 - 1114
  • [36] A note on quantile feature screening via distance correlation
    Chen, Xiaolin
    Chen, Xiaojing
    Liu, Yi
    STATISTICAL PAPERS, 2019, 60 (05) : 1741 - 1762
  • [37] MODEL-FREE FEATURE SCREENING FOR ULTRAHIGH DIMENSIONAL DATATHROUGH A MODIFIED BLUM-KIEFER-ROSENBLATT CORRELATION
    Zhou, Yeqing
    Zhu, Liping
    STATISTICA SINICA, 2018, 28 (03) : 1351 - 1370
  • [38] Conditional-quantile screening for ultrahigh-dimensional survival data via martingale difference correlation
    Xu, Kai
    Huang, Xudong
    SCIENCE CHINA-MATHEMATICS, 2018, 61 (10) : 1907 - 1922
  • [39] Fast and powerful conditional randomization testing via distillation
    Liu, Molei
    Katsevich, Eugene
    Janson, Lucas
    Ramdas, Aaditya
    BIOMETRIKA, 2022, 109 (02) : 277 - 293
  • [40] Conditional sure independence screening by conditional marginal empirical likelihood
    Qinqin Hu
    Lu Lin
    Annals of the Institute of Statistical Mathematics, 2017, 69 : 63 - 96