Digital Twin for Federated Analytics Using a Bayesian Approach

被引:23
作者
Chen, Dawei [1 ]
Wang, Dan [2 ]
Zhu, Yifei [3 ]
Han, Zhu [1 ,4 ]
机构
[1] Univ Houston, Dept Elect & Comp Engn, Houston, TX 77004 USA
[2] Hong Kong Polytech Univ, Dept Comp, Hong Kong, Peoples R China
[3] Shanghai Jiao Tong Univ, Univ Michigan, Shanghai Jiao Tong Univ Joint Inst, Shanghai 200240, Peoples R China
[4] Kyung Hee Univ, Dept Comp Sci & Engn, Seoul 446701, South Korea
关键词
Digital twin; Monte Carlo methods; Markov processes; Internet of Things; Distributed databases; Data models; Convergence; Delayed rejection; digital twin; edge computing; federated analytics; finite Gaussian mixture; Markov chain Monte Carlo (MCMC); MONTE-CARLO METHODS; SCHEME;
D O I
10.1109/JIOT.2021.3098692
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
We are now in an information era and the volume of data is growing explosively. However, due to privacy issues, it is very common that data cannot be freely shared among the data generating. Federated analytics was recently proposed aiming at deriving analytical insights among data-generating devices without exposing the raw data, but the intermediate analytics results. Note that the computing resources at the data generating devices are limited, thus making on-device execution of computing-intensive tasks challenging. We thus propose to apply the digital twin technique, which emulates the resource-limited physical/end side, while utilizing the rich resource at the virtual/computing side. Nevertheless, how to use the digital twin technique to assist federated analytics while preserving distributed data privacy is challenging. To address such a challenge, this work first formulates a problem on digital twin-assisted federated distribution discovery. Then, we propose a federated Markov chain Monte Carlo with a delayed rejection (FMCMC-DR) method to estimate the representative parameters of the global distribution. We combine a rejection-acceptance sampling technique and a delayed rejection technique, allowing our method to be able to explore the full state space. Finally, we evaluate FMCMC-DR against the Metropolis-Hastings (MH) algorithm and random walk Markov chain Monte Carlo method (RW-MCMC) using numerical experiments. The results show our algorithm outperforms the other two methods by 50% and 95% contour accuracy, respectively, and has a better convergence rate.
引用
收藏
页码:16301 / 16312
页数:12
相关论文
共 42 条
[1]  
[Anonymous], 2001, Metron
[2]   Model-Based Design of Complex Aeronautical Systems Through Digital Twin and Thread Concepts [J].
Bachelor, Gray ;
Brusa, Eugenio ;
Ferretto, Davide ;
Mitschke, Andreas .
IEEE SYSTEMS JOURNAL, 2020, 14 (02) :1568-1579
[3]   Constructing Pathway-Based Priors within a Gaussian Mixture Model for Bayesian Regression and Classification [J].
Boluki, Shahin ;
Esfahani, Mohammad Shahrokh ;
Qian, Xiaoning ;
Dougherty, Edward R. .
IEEE-ACM TRANSACTIONS ON COMPUTATIONAL BIOLOGY AND BIOINFORMATICS, 2019, 16 (02) :524-537
[4]   Data Science: A Comprehensive Overview [J].
Cao, Longbing .
ACM COMPUTING SURVEYS, 2017, 50 (03)
[5]   Incremental Factorization of Big Time Series Data with Blind Factor Approximation [J].
Chen, Dan ;
Tang, Yunbo ;
Zhang, Hao ;
Wang, Lizhe ;
Li, Xiaoli .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2021, 33 (02) :569-584
[6]   FedSVRG Based Communication Efficient Scheme for Federated Learning in MEC Networks [J].
Chen, Dawei ;
Hong, Choong Seon ;
Zha, Yiyong ;
Zhang, Yunfei ;
Liu, Xin ;
Han, Zhu .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2021, 70 (07) :7300-7304
[7]   Matching-Theory-Based Low-Latency Scheme for Multitask Federated Learning in MEC Networks [J].
Chen, Dawei ;
Hong, Choong Seon ;
Wang, Li ;
Zha, Yiyong ;
Zhang, Yunfei ;
Liu, Xin ;
Han, Zhu .
IEEE INTERNET OF THINGS JOURNAL, 2021, 8 (14) :11415-11426
[8]   Heuristic Monte Carlo Algorithm for Unmanned Ground Vehicles Realtime Localization and Mapping [J].
Chen, Dunjin ;
Weng, Jian ;
Huang, Feiran ;
Zhou, Jian ;
Mao, Yijun ;
Liu, Xiaodong .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2020, 69 (10) :10642-10655
[9]   A Joint Update Parallel MCMC-Method-Based Sparse Code Multiple Access Decoder [J].
Chen, Jienan ;
Zhang, Zhenbin ;
Fu, Shengli ;
Hu, Jianhao .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2018, 67 (02) :1280-1291
[10]  
Daniels MJ, 2008, MONOGR STAT APPL PRO, V109, P1