Privacy-Preserving News Recommendation Model Learning

被引:0
作者
Qi, Tao [1 ]
Wu, Fangzhao [2 ]
Wu, Chuhan [1 ]
Huang, Yongfeng [1 ]
Xie, Xing [2 ]
机构
[1] Tsinghua Univ, Dept Elect Engn & BNRist, Beijing 100084, Peoples R China
[2] Microsoft Res Asia, Beijing 100080, Peoples R China
来源
FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, EMNLP 2020 | 2020年
基金
中国国家自然科学基金;
关键词
DIFFERENTIAL PRIVACY;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
News recommendation aims to display news articles to users based on their personal interest. Existing news recommendation methods rely on centralized storage of user behavior data for model training, which may lead to privacy concerns and risks due to the privacy-sensitive nature of user behaviors. In this paper, we propose a privacy-preserving method for news recommendation model training based on federated learning, where the user behavior data is locally stored on user devices. Our method can leverage the useful information in the behaviors of massive number users to train accurate news recommendation models and meanwhile remove the need of centralized storage of them. More specifically, on each user device we keep a local copy of the news recommendation model, and compute gradients of the local model based on the user behaviors in this device. The local gradients from a group of randomly selected users are uploaded to server, which are further aggregated to update the global model in the server. Since the model gradients may contain some implicit private information, we apply local differential privacy (LDP) to them before uploading for better privacy protection. The updated global model is then distributed to each user device for local model update. We repeat this process for multiple rounds. Extensive experiments on a real-world dataset show the effectiveness of our method in news recommendation model training with privacy protection.
引用
收藏
页码:1423 / 1432
页数:10
相关论文
共 28 条
[1]  
Ammad-ud-din M, 2019, Arxiv, DOI arXiv:1901.09888
[2]  
An MX, 2019, 57TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2019), P336
[3]  
Chai D, 2019, Arxiv, DOI arXiv:1906.05108
[4]  
Cho K., 2014, P SSST 8 8 WORKSH SY, DOI DOI 10.3115/V1/W14-4012
[5]   Guaranteeing Local Differential Privacy on Ultra-low-power Systems [J].
Choi, Woo-Seok ;
Tomei, Matthew ;
Vicarte, Jose Rodrigo Sanchez ;
Hanumolu, Pavan Kumar ;
Kumar, Rakesh .
2018 ACM/IEEE 45TH ANNUAL INTERNATIONAL SYMPOSIUM ON COMPUTER ARCHITECTURE (ISCA), 2018, :561-574
[6]   Privacy at Scale: Local Differential Privacy in Practice [J].
Cormode, Graham ;
Jha, Somesh ;
Kulkarni, Tejas ;
Li, Ninghui ;
Srivastava, Divesh ;
Wang, Tianhao .
SIGMOD'18: PROCEEDINGS OF THE 2018 INTERNATIONAL CONFERENCE ON MANAGEMENT OF DATA, 2018, :1655-1658
[7]   Local Privacy and Statistical Minimax Rates [J].
Duchi, John C. ;
Jordan, Michael I. ;
Wainwright, Martin J. .
2013 IEEE 54TH ANNUAL SYMPOSIUM ON FOUNDATIONS OF COMPUTER SCIENCE (FOCS), 2013, :429-438
[8]   The Adressa Dataset for News Recommendation [J].
Gulla, Jon Atle ;
Zhang, Lemei ;
Liu, Peng ;
Ozgobek, Ozlem ;
Su, Xiaomeng .
2017 IEEE/WIC/ACM INTERNATIONAL CONFERENCE ON WEB INTELLIGENCE (WI 2017), 2017, :1042-1048
[9]  
Hu LM, 2020, 58TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2020), P4255
[10]   Federated Topic Modeling [J].
Jiang, Di ;
Song, Yuanfeng ;
Tong, Yongxin ;
Wu, Xueyang ;
Zhao, Weiwei ;
Xu, Qian ;
Yang, Qiang .
PROCEEDINGS OF THE 28TH ACM INTERNATIONAL CONFERENCE ON INFORMATION & KNOWLEDGE MANAGEMENT (CIKM '19), 2019, :1071-1080