Minimax rates of convergence for sliced inverse regression with differential privacy

被引:1
作者
Zhao, Wenbiao [1 ]
Zhu, Xuehu [2 ]
Zhu, Lixing [3 ]
机构
[1] Beijing Inst Technol, Sch Math & Stat, Beijing, Peoples R China
[2] Xi An Jiao Tong Univ, Sch Math & Stat, Xian, Peoples R China
[3] Beijing Normal Univ Zhuhai, Ctr Stat & Data Sci, Zhuhai, Peoples R China
基金
美国国家科学基金会;
关键词
Sliced inverse regression; Differential privacy; Minimax rate; DIMENSION REDUCTION; NOISE;
D O I
10.1016/j.csda.2024.108041
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Sliced inverse regression (SIR) is a highly efficient paradigm used for the purpose of dimension reduction by replacing high-dimensional covariates with a limited number of linear combinations. This paper focuses on the implementation of the classical SIR approach integrated with a Gaussian differential privacy mechanism to estimate the central space while preserving privacy. We illustrate the tradeoff between statistical accuracy and privacy in sufficient dimension reduction problems under both the classical low- dimensional and modern high-dimensional settings. Additionally, we achieve the minimax rate of the proposed estimator with Gaussian differential privacy constraint and illustrate that this rate is also optimal for multiple index models with bounded dimension of the central space. Extensive numerical studies on synthetic data sets are conducted to assess the effectiveness of the proposed technique in finite sample scenarios, and a real data analysis is presented to showcase its practical application.
引用
收藏
页数:25
相关论文
共 35 条
[1]  
Cai TY, 2023, Arxiv, DOI arXiv:2303.07152
[2]   THE COST OF PRIVACY: OPTIMAL RATES OF CONVERGENCE FOR PARAMETER ESTIMATION WITH DIFFERENTIAL PRIVACY [J].
Cai, T. Tony ;
Wang, Yichen ;
Zhang, Linjun .
ANNALS OF STATISTICS, 2021, 49 (05) :2825-2850
[3]   SPARSE PCA: OPTIMAL RATES AND ADAPTIVE ESTIMATION [J].
Cai, T. Tony ;
Ma, Zongming ;
Wu, Yihong .
ANNALS OF STATISTICS, 2013, 41 (06) :3074-3110
[4]  
Cai ZR, 2020, J MACH LEARN RES, V21
[5]  
Cook R.D., 2009, Regression graphics: Ideas for studying regressions through graphics
[6]  
COOK RD, 1991, J AM STAT ASSOC, V86, P328, DOI 10.2307/2290564
[7]  
Dong JS, 2022, J ROY STAT SOC B, V84, P3, DOI 10.1111/rssb.12454
[8]  
Dwork C., 2021, J. Priv. Confid., V11, P716
[9]  
Dwork C, 2006, LECT NOTES COMPUT SC, V4004, P486
[10]   Calibrating noise to sensitivity in private data analysis [J].
Dwork, Cynthia ;
McSherry, Frank ;
Nissim, Kobbi ;
Smith, Adam .
THEORY OF CRYPTOGRAPHY, PROCEEDINGS, 2006, 3876 :265-284