A Docker-based federated learning framework design and deployment for multi-modal data stream classification

被引:0
作者
Arijit Nandi
Fatos Xhafa
Rohit Kumar
机构
[1] Universitat Politècnica de Catalunya,Department of CS
[2] Eurecat,undefined
[3] Centre Tecnològic de Catalunya,undefined
来源
Computing | 2023年 / 105卷
关键词
Federated learning; High performance computing; Multi-modal data streaming; Docker-container; Real-time emotion classification; 68W15; 94A16; 68M20; 68T05; 68T07; 68P27;
D O I
暂无
中图分类号
学科分类号
摘要
In the high-performance computing (HPC) domain, federated learning has gained immense popularity. Especially in emotional and physical health analytics and experimental facilities. Federated learning is one of the most promising distributed machine learning frameworks because it supports data privacy and security by not sharing the clients’ data but instead sharing their local models. In federated learning, many clients explicitly train their machine learning/deep learning models (local training) before aggregating them as a global model at the global server. However, the FL framework is difficult to build and deploy across multiple distributed clients due to its heterogeneous nature. We developed Docker-enabled federated learning (DFL) by utilizing client-agnostic technologies like Docker containers to simplify the deployment of FL frameworks for data stream processing on the heterogeneous client. In the DFL, the clients and global servers are written using TensorFlow and lightweight message queuing telemetry transport protocol to communicate between clients and global servers in the IoT environment. Furthermore, the DFL’s effectiveness, efficiency, and scalability are evaluated in the test case scenario where real-time emotion state classification is done from distributed multi-modal physiological data streams under various practical configurations.
引用
收藏
页码:2195 / 2229
页数:34
相关论文
共 107 条
[1]  
Chen Z(2021)Towards asynchronous federated learning for heterogeneous edge-powered internet of things Digital Commun Netw 7 317-326
[2]  
Liao W(2022)Federated learning in edge computing: a systematic survey Sensors 119 97-109
[3]  
Hua K(2018)Application deployment using microservice and docker containers: Framework and optimization J Netw Comput Appl 204 340-347
[4]  
Lu C(2022)A federated learning method for real-time emotion state classification from multi-modal streaming Methods 139 38-52
[5]  
Yu W(2023)A federated cloud architecture for processing of cancer images on a distributed storage Futur Gen Comput Syst 10 134-145
[6]  
Abreha HG(2022)A docker container anomaly monitoring system based on optimized isolation forest IEEE Trans Cloud Comput 9 13740-13754
[7]  
Hayajneh M(2022)Easyfl: a low-code federated learning platform for dummies IEEE Internet Things J 1 105-115
[8]  
Serhani MA(2019)Paddlepaddle: an open-source deep learning platform from industrial practice Front Data Comput 108 1984-2012
[9]  
Wan X(2020)Scaling-up distributed processing of data streams for machine learning Proc IEEE 11 1601-1604
[10]  
Guan X(2010)Moa: Massive online analysis J Mach Learn Res 106 1469-1495