Evaluation and comparison of federated learning algorithms for Human Activity Recognition on smartphones

被引:3
作者
Ek S. [1 ]
Portet F. [1 ]
Lalanda P. [1 ]
Vega G. [1 ]
机构
[1] University Grenoble Alpes, CNRS, Grenoble INP, LIG, Grenoble
关键词
Evaluation method; Federated learning; Human Activity Recognition;
D O I
10.1016/j.pmcj.2022.101714
中图分类号
学科分类号
摘要
Pervasive computing promotes the integration of smart devices in our living spaces to develop services providing assistance to people. Such smart devices are increasingly relying on cloud-based Machine Learning, which raises questions in terms of security (data privacy), reliance (latency), and communication costs. In this context, Federated Learning (FL) has been introduced as a new machine learning paradigm enhancing the use of local devices. At the server level, FL aggregates models learned locally on distributed clients to obtain a more general model. In this way, no private data is sent over the network, and the communication cost is reduced. Unfortunately, however, the most popular federated learning algorithms have been shown not to be adapted to some highly heterogeneous pervasive computing environments. In this paper, we propose a new FL algorithm, termed FedDist, which can modify models (here, deep neural network) during training by identifying dissimilarities between neurons among the clients. This permits to account for clients’ specificity without impairing generalization. FedDist evaluated with three state-of-the-art federated learning algorithms on three large heterogeneous mobile Human Activity Recognition datasets. Results have shown the ability of FedDist to adapt to heterogeneous data and the capability of FL to deal with asynchronous situations. © 2022 Elsevier B.V.
引用
收藏
相关论文
共 34 条
  • [1] Shi W., Cao J., Zhang Q., Li Y., Xu L., Edge computing: Vision and challenges, IEEE Internet Things J., 3, 5, pp. 637-646, (2016)
  • [2] Becker C., Julien C., Lalanda P., Zambonelli F., Pervasive computing middleware: current trends and emerging challenges, CCF Trans. Pervasive Comput. Interact., 1, (2019)
  • [3] McMahan B., Moore E., Ramage D., Hampson S., 54, pp. 1273-1282, (2017)
  • [4] Bonawitz K., Eichner H., Grieskamp W., Huba D., Ingerman A., Ivanov V., Kiddon C., Konesny J., Mazzocchi S., McMahan B., 1, pp. 374-388, (2019)
  • [5] Konecny J., McMahan H.B., Ramage D., Richtarik P., Federated optimization: Distributed machine learning for on-device intelligence, (2016)
  • [6] Lim W.Y.B., Luong N.C., Hoang D.T., Jiao Y., Liang Y.C., Yang Q., Niyato D., Miao C., Federated learning in mobile edge networks: A comprehensive survey, IEEE Commun. Surv. Tutor., 22, 3, pp. 2031-2063, (2020)
  • [7] Ghuhan Arivazhagan M., Aggarwal V., Singh A.K., Choudhary S., Federated learning with personalization layers, (2019)
  • [8] Li D., Wang J., FedMD: Heterogenous federated learning via model distillation, (2019)
  • [9] Wang H., Yurochkin M., Sun Y., Papailiopoulos D., Khazaeni Y., Federated Learning with Matched Averaging, (2020)
  • [10] Nguyen D.C., Ding M., Pathirana P.N., Seneviratne A., Li J., Vincent Poor H., Federated learning for internet of things: A comprehensive survey, IEEE Commun. Surv. Tutor., 23, 3, pp. 1622-1658, (2021)