Model-free conditional screening via conditional distance correlation

被引:19
|
作者
Lu, Jun [1 ]
Lin, Lu [1 ,2 ]
机构
[1] Shandong Univ, Zhongtai Secur Inst Financial Studies, Jinan 250100, Peoples R China
[2] Qufu Normal Univ, Sch Stat, Qufu 273165, Shandong, Peoples R China
关键词
Ultrahigh dimensionality; Model free; Conditional distance correlation; Sure screening; VARIABLE SELECTION; LIKELIHOOD; REGRESSION; LASSO;
D O I
10.1007/s00362-017-0931-7
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
With the knowledge on the predetermined active predictors, we develop a feature screening procedure via the conditional distance correlation learning. The proposed procedure can significantly lower the correlation among the predictors when they are highly correlated and thus reduce the numbers of false positive and false negative. Meanwhile, when the conditional set is unable to be accessed beforehand, a data-driven method is provided to select it. We establish both the ranking consistency and the sure screening property for the new proposed procedure. To compare the performance of our method with its competitors, extensive simulations are conducted, which shows that the new procedure performs well in both the linear and nonlinear models. Finally, a real data analysis is investigated to further illustrate the effectiveness of the new method.
引用
收藏
页码:225 / 244
页数:20
相关论文
共 50 条
  • [21] Model-free conditional feature screening for ultra-high dimensional right censored data
    Chen, Xiaolin
    JOURNAL OF STATISTICAL COMPUTATION AND SIMULATION, 2018, 88 (12) : 2425 - 2446
  • [22] A Flexibly Conditional Screening Approach via a Nonparametric Quantile Partial Correlation
    Xia, Xiaochao
    Ming, Hao
    MATHEMATICS, 2022, 10 (24)
  • [23] Conditional Sure Independence Screening
    Barut, Emre
    Fan, Jianqing
    Verhasselt, Anneleen
    JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2016, 111 (515) : 1266 - 1277
  • [24] Model-Free Forward Screening Via Cumulative Divergence
    Zhou, Tingyou
    Zhu, Liping
    Xu, Chen
    Li, Runze
    JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2020, 115 (531) : 1393 - 1405
  • [25] Conditional quantile correlation screening procedure for ultrahigh-dimensional varying coefficient models
    Li, Xiangjie
    Ma, Xuejun
    Zhang, Jingxiao
    JOURNAL OF STATISTICAL PLANNING AND INFERENCE, 2018, 197 : 69 - 92
  • [26] Scalable Model-Free Feature Screening via Sliced-Wasserstein Dependency
    Li, Tao
    Yu, Jun
    Meng, Cheng
    JOURNAL OF COMPUTATIONAL AND GRAPHICAL STATISTICS, 2023, 32 (04) : 1501 - 1511
  • [27] Feature Screening via Distance Correlation Learning
    Li, Runze
    Zhong, Wei
    Zhu, Liping
    JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2012, 107 (499) : 1129 - 1139
  • [28] Variable screening for ultrahigh dimensional heterogeneous data via conditional quantile correlations
    Zhang, Shucong
    Zhou, Yong
    JOURNAL OF MULTIVARIATE ANALYSIS, 2018, 165 : 1 - 13
  • [29] Conditional distance correlation sure independence screening for ultra-high dimensional survival data
    Lu, Shuiyun
    Chen, Xiaolin
    Wang, Hong
    COMMUNICATIONS IN STATISTICS-THEORY AND METHODS, 2021, 50 (08) : 1936 - 1953
  • [30] Unified model-free interaction screening via CV-entropy filter
    Xiong, Wei
    Chen, Yaxian
    Ma, Shuangge
    COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2023, 180