Federated Learning: A signal processing perspective

被引:60
作者
Gafni, Tomer [1 ]
Shlezinger, Nir [1 ,2 ,3 ]
Cohen, Kobi [1 ]
Eldar, Yonina C. [4 ,5 ,6 ]
Poor, H. Vincent [7 ,8 ,9 ,10 ,11 ]
机构
[1] Ben Gurion Univ Negev, Sch Elect & Comp Engn, IL-8410501 Beer Sheva, Israel
[2] Technion Israel Inst Technol, Haifa, Israel
[3] Weizmann Inst Sci, Signal Acquisit Modeling Proc & Learning Lab, Rehovot, Israel
[4] Weizmann Inst Sci, Dept Math & Comp Sci, IL-7610001 Rehovot, Israel
[5] Weizmann Inst Sci, Ctr Biomed Engn & Signal Proc, IL-7610001 Rehovot, Israel
[6] Israel Acad Sci & Humanities, West Jerusalem, Israel
[7] Princeton Univ, Princeton, NJ 08544 USA
[8] US Natl Acad Engn, Washington, DC USA
[9] US Natl Acad Sci, Washington, DC USA
[10] Chinese Acad Sci, Beijing, Peoples R China
[11] Royal Soc, London, England
基金
以色列科学基金会;
关键词
Deep learning; Training; Data privacy; Signal processing; Collaborative work; Data models; Sensors; COMPUTATION; ALLOCATION; PRIVACY; DESIGN; NOISE;
D O I
10.1109/MSP.2021.3125282
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The dramatic success of deep learning is largely due to the availability of data. Data samples are often acquired on edge devices, such as smartphones, vehicles, and sensors, and in some cases cannot be shared due to privacy considerations. Federated learning is an emerging machine learning paradigm for training models across multiple edge devices holding local data sets, without explicitly exchanging the data. Learning in a federated manner differs from conventional centralized machine learning and poses several core unique challenges and requirements, which are closely related to classical problems studied in the areas of signal processing and communications. Consequently, dedicated schemes derived from these areas are expected to play an important role in the success of federated learning and the transition of deep learning from the domain of centralized servers to mobile edge devices.
引用
收藏
页码:14 / 41
页数:28
相关论文
共 61 条
  • [1] Abari Omid, 2015, 2015 IEEE Conference on Computer Communications (INFOCOM). Proceedings, P1742, DOI 10.1109/INFOCOM.2015.7218555
  • [2] Alistarh D, 2017, ADV NEUR IN, V30
  • [3] Blind Federated Edge Learning
    Amiri, Mohammad Mohammadi
    Duman, Tolga M.
    Gunduz, Deniz
    Kulkarni, Sanjeev R.
    Poor, H. Vincent
    [J]. IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2021, 20 (08) : 5129 - 5143
  • [4] Federated Learning Over Wireless Fading Channels
    Amiri, Mohammad Mohammadi
    Gunduz, Deniz
    [J]. IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2020, 19 (05) : 3546 - 3557
  • [5] Machine Learning at the Wireless Edge: Distributed Stochastic Gradient Descent Over-the-Air
    Amiri, Mohammad Mohammadi
    Gunduz, Deniz
    [J]. IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2020, 68 (68) : 2155 - 2169
  • [6] The effects of adding noise during backpropagation training on a generalization performance
    An, GZ
    [J]. NEURAL COMPUTATION, 1996, 8 (03) : 643 - 674
  • [7] Resource Management and Model Personalization for Federated Learning over Wireless Edge Networks
    Balakrishnan, Ravikumar
    Akdeniz, Mustafa
    Dhakal, Sagar
    Anand, Arjun
    Zeira, Ariela
    Himayat, Nageen
    [J]. JOURNAL OF SENSOR AND ACTUATOR NETWORKS, 2021, 10 (01)
  • [8] Bernstein J, 2018, PR MACH LEARN RES, V80
  • [9] Bonawitz K., 2019, ARXIV190201046
  • [10] Practical Secure Aggregation for Privacy-Preserving Machine Learning
    Bonawitz, Keith
    Ivanov, Vladimir
    Kreuter, Ben
    Marcedone, Antonio
    McMahan, H. Brendan
    Patel, Sarvar
    Ramage, Daniel
    Segal, Aaron
    Seth, Karn
    [J]. CCS'17: PROCEEDINGS OF THE 2017 ACM SIGSAC CONFERENCE ON COMPUTER AND COMMUNICATIONS SECURITY, 2017, : 1175 - 1191