Truthful and privacy-preserving generalized linear models

被引:0
作者
Qiu, Yuan [1 ]
Liu, Jinyan [2 ]
Wang, Di [3 ,4 ,5 ]
机构
[1] Georgia Inst Technol, Coll Comp, Atlanta, GA USA
[2] Beijing Inst Technol, Sch Comp Sci & Technol, Beijing, Peoples R China
[3] Provable Responsible AI & Data Analyt Lab, Thuwal, Saudi Arabia
[4] SDAIA KAUST Ctr Excellence Data Sci & Artificial, Thuwal, Saudi Arabia
[5] King Abdullah Univ Sci & Technol, Div CEMSE, Thuwal, Saudi Arabia
基金
中国国家自然科学基金;
关键词
Generalized linear models; Bayesian game; Differential privacy; Truthful mechanism design;
D O I
10.1016/j.ic.2024.105225
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
This paper explores estimating Generalized Linear Models (GLMs) when agents are strategic and privacy-conscious. We aim to design mechanisms that encourage truthful reporting, protect privacy, and ensure outputs are close to the true parameters. Initially, we address models with sub-Gaussian covariates and heavy-tailed responses with finite fourth moments, proposing a novel private, closed-form estimator. Our mechanism features: (1) o(1)-joint differential privacy with high probability; (2) o(1/n)-approximate Bayes Nash equilibrium for (1 - o(1))-fraction of agents; (3) o(1) error in parameter estimation; (4) individual rationality for (1 -o(1)) of agents; (5) o(1) payment budget. We then extend our approach to linear regression with heavy-tailed data, using an l(4)-norm shrinkage operator to propose a similar estimator and payment scheme. (c) 2024 Elsevier Inc. All rights are reserved, including those for text and data mining, AI training, and similar technologies.
引用
收藏
页数:30
相关论文
共 43 条
  • [1] Peer Prediction with Heterogeneous Users
    Agarwal, Arpit
    Mandal, Debmalya
    Parkes, David C.
    Shah, Nisarg
    [J]. ACM TRANSACTIONS ON ECONOMICS AND COMPUTATION, 2020, 8 (01)
  • [2] Crowdsourcing Twitter annotations to identify first-hand experiences of prescription drug use
    Alvaro, Nestor
    Conway, Mike
    Doan, Son
    Lofi, Christoph
    Overington, John
    Collier, Nigel
    [J]. JOURNAL OF BIOMEDICAL INFORMATICS, 2015, 58 : 280 - 287
  • [3] Bassily R, 2021, ADV NEUR IN, V34
  • [4] Biswas A., 2007, Statistical Advances in the Biomedical Science
  • [5] Cai Y., 2015, C LEARNING THEORY, P280
  • [6] Chaudhuri K, 2011, J MACH LEARN RES, V12, P1069
  • [7] Chen Y., 2020, Advances in Neural Information Processing Systems, V33, P15265
  • [8] Chen Y., 2020, Advances in Neural Information Processing Systems, V33, P18194
  • [9] Strategyproof Linear Regression in High Dimensions
    Chen, Yiling
    Podimata, Chara
    Procaccia, Ariel D.
    Shah, Nisarg
    [J]. ACM EC'18: PROCEEDINGS OF THE 2018 ACM CONFERENCE ON ECONOMICS AND COMPUTATION, 2018, : 9 - 26
  • [10] Cummings R., 2015, C LEARNING THEORY, P448