POST-SELECTION INFERENCE VIA ALGORITHMIC STABILITY

被引:8
作者
Zrnic, Tijana [1 ]
Jordan, Michael I. [1 ]
机构
[1] Univ Calif Berkeley, Dept Elect Engn & Comp Sci, Berkeley, CA 94720 USA
基金
英国工程与自然科学研究理事会;
关键词
Post-selection inference; selective inference; stability; differential privacy; model selection; linear regression; PREDICTIVE INFERENCE;
D O I
10.1214/23-AOS2303
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
When the target of statistical inference is chosen in a data-driven manner, the guarantees provided by classical theories vanish. We propose a solution to the problem of inference after selection by building on the framework of algorithmic stability, in particular its branch with origins in the field of differential privacy. Stability is achieved via randomization of selection and it serves as a quantitative measure that is sufficient to obtain nontrivial post-selection corrections for classical confidence intervals. Importantly, the underpinnings of algorithmic stability translate directly into computational efficiency-our method computes simple corrections for selective inference without recourse to Markov chain Monte Carlo sampling.
引用
收藏
页码:1666 / 1691
页数:26
相关论文
共 54 条
[1]  
Andrews I., 2019, Inference on winners
[2]   UNIFORMLY VALID CONFIDENCE INTERVALS POST-MODEL-SELECTION [J].
Bachoc, Francois ;
Preinerstorfer, David ;
Steinberger, Lukas .
ANNALS OF STATISTICS, 2020, 48 (01) :440-463
[3]   PREDICTIVE INFERENCE WITH THE JACKKNIFE [J].
Barber, Rina Foygel ;
Candes, Emmanuel J. ;
Ramdas, Aaditya ;
Tibshirani, Ryan J. .
ANNALS OF STATISTICS, 2021, 49 (01) :486-507
[4]  
Bassily R, 2016, Arxiv, DOI arXiv:1604.03336
[5]   Algorithmic Stability for Adaptive Data Analysis [J].
Bassily, Raef ;
Nissim, Kobbi ;
Smith, Adam ;
Steinke, Thomas ;
Stemmer, Uri ;
Ullman, Jonathan .
STOC'16: PROCEEDINGS OF THE 48TH ANNUAL ACM SIGACT SYMPOSIUM ON THEORY OF COMPUTING, 2016, :1046-1059
[6]  
Beimel A, 2010, LECT NOTES COMPUT SC, V5978, P437, DOI 10.1007/978-3-642-11799-2_26
[7]  
Benjamini Y, 2019, Arxiv, DOI [arXiv:1906.00505, 10.48550/arXiv.1906.00505, DOI 10.48550/ARXIV.1906.00505]
[8]   Simultaneous and selective inference: Current successes and future challenges [J].
Benjamini, Yoav .
BIOMETRICAL JOURNAL, 2010, 52 (06) :708-721
[9]   VALID POST-SELECTION INFERENCE [J].
Berk, Richard ;
Brown, Lawrence ;
Buja, Andreas ;
Zhang, Kai ;
Zhao, Linda .
ANNALS OF STATISTICS, 2013, 41 (02) :802-837
[10]   Inferactive data analysis [J].
Bi, Nan ;
Markovic, Jelena ;
Xia, Lucy ;
Taylor, Jonathan .
SCANDINAVIAN JOURNAL OF STATISTICS, 2020, 47 (01) :212-249