RANK: Large-Scale Inference With Graphical Nonlinear Knockoffs

被引:40
作者
Fan, Yingying [1 ]
Demirkaya, Emre [2 ]
Li, Gaorong [3 ]
Lv, Jinchi [1 ]
机构
[1] Univ Southern Calif, Marshall Sch Business, Data Sci & Operat Dept, Los Angeles, CA 90089 USA
[2] Univ Tennessee, Dept Business Analyt & Stat, Haslam Coll Business, Knoxville, TN USA
[3] Beijing Univ Technol, Beijing Inst Sci & Engn Comp, Beijing, Peoples R China
关键词
Big data; Graphical nonlinear knockoffs; High-dimensional nonlinear models; Large-scale inference and FDR; Power; Reproducibility; Robustness; FALSE DISCOVERY RATE; VARIABLE SELECTION; UNKNOWN SPARSITY; REGRESSION; TESTS; IDENTIFICATION; BOOTSTRAP; RATES;
D O I
10.1080/01621459.2018.1546589
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
Power and reproducibility are key to enabling refined scientific discoveries in contemporary big data applications with general high-dimensional nonlinear models. In this article, we provide theoretical foundations on the power and robustness for the model-X knockoffs procedure introduced recently in Candes, Fan, Janson and Lv in high-dimensional setting when the covariate distribution is characterized by Gaussian graphical model. We establish that under mild regularity conditions, the power of the oracle knockoffs procedure with known covariate distribution in high-dimensional linear models is asymptotically one as sample size goes to infinity. When moving away from the ideal case, we suggest the modified model-X knockoffs method called graphical nonlinear knockoffs (RANK) to accommodate the unknown covariate distribution. We provide theoretical justifications on the robustness of our modified procedure by showing that the false discovery rate (FDR) is asymptotically controlled at the target level and the power is asymptotically one with the estimated covariate distribution. To the best of our knowledge, this is the first formal theoretical result on the power for the knockoffs procedure. Simulation results demonstrate that compared to existing approaches, our method performs competitively in both FDR control and power. A real dataset is analyzed to further assess the performance of the suggested knockoffs procedure. for this article are available online.
引用
收藏
页码:362 / 379
页数:18
相关论文
共 50 条
  • [21] MAXIMIN EFFECTS IN INHOMOGENEOUS LARGE-SCALE DATA
    Meinshausen, Nicolai
    Buehlmann, Peter
    ANNALS OF STATISTICS, 2015, 43 (04) : 1801 - 1830
  • [22] A Bayesian Graphical Approach for Large-Scale Portfolio Management with Fewer Historical Data
    Oya, Sakae
    ASIA-PACIFIC FINANCIAL MARKETS, 2022, 29 (03) : 507 - 526
  • [23] LARGE-SCALE MULTIPLE INFERENCE OF COLLECTIVE DEPENDENCE WITH APPLICATIONS TO PROTEIN FUNCTION
    Jernigan, Robert
    Jia, Kejue
    Ren, Zhao
    Zhou, Wen
    ANNALS OF APPLIED STATISTICS, 2021, 15 (02) : 902 - 924
  • [24] Foundational Principles for Large-Scale Inference: Illustrations Through Correlation Mining
    Hero, Alfred O., III
    Rajaratnam, Bala
    PROCEEDINGS OF THE IEEE, 2016, 104 (01) : 93 - 110
  • [25] A tutorial on rank-based coefficient estimation for censored data in small- and large-scale problems
    Chung, Matthias
    Long, Qi
    Johnson, Brent A.
    STATISTICS AND COMPUTING, 2013, 23 (05) : 601 - 614
  • [26] A Robust Method for Large-Scale Multiple Hypotheses Testing
    Han, Seungbong
    Andrei, Adin-Cristian
    Tsui, Kam-Wah
    BIOMETRICAL JOURNAL, 2010, 52 (02) : 222 - 232
  • [27] Low-rank approximation of large-scale matrices via randomized methods
    Sarvenaz Hatamirad
    Mir Mohsen Pedram
    The Journal of Supercomputing, 2018, 74 : 830 - 844
  • [28] Low-rank approximation of large-scale matrices via randomized methods
    Hatamirad, Sarvenaz
    Pedram, Mir Mohsen
    JOURNAL OF SUPERCOMPUTING, 2018, 74 (02) : 830 - 844
  • [29] Regularized Estimation of Large-Scale Gene Association Networks using Graphical Gaussian Models
    Kraemer, Nicole
    PLS '09: PROCEEDINGS OF THE 6TH INTERNATIONAL CONFERENCE ON PARTIAL LEAST SQUARES AND RELATED METHODS, 2009, : 367 - 369
  • [30] An Incremental and Distributed Inference Method for Large-Scale Ontologies Based on MapReduce Paradigm
    Liu, Bo
    Huang, Keman
    Li, Jianqiang
    Zhou, MengChu
    IEEE TRANSACTIONS ON CYBERNETICS, 2015, 45 (01) : 53 - 64