A Blockchain-Based Scheme for Secure Data Offloading in Healthcare With Deep Reinforcement Learning

被引:85
作者
He, Qiang [1 ]
Feng, Zheng [1 ]
Fang, Hui [2 ,3 ]
Wang, Xingwei [4 ]
Zhao, Liang [5 ]
Yao, Yudong [6 ]
Yu, Keping [7 ]
机构
[1] Northeastern Univ, Coll Med & Biol Informat Engn, Shenyang 110169, Peoples R China
[2] Shanghai Univ Finance & Econ, Res Inst Interdisciplinary Sci, Shanghai 200433, Peoples R China
[3] Shanghai Univ Finance & Econ, Sch Informat Management & Engn, Shanghai 200433, Peoples R China
[4] Northeastern Univ, Coll Comp Sci & Engn, Shenyang 110169, Peoples R China
[5] Shenyang Aerosp Univ, Coll Comp Sci & Engn, Shenyang 110136, Peoples R China
[6] Stevens Inst Technol, Dept Elect & Comp Engn, Hoboken, NJ 07030 USA
[7] Hosei Univ, Grad Sch Sci & Engn, Tokyo 1848584, Japan
基金
日本学术振兴会; 中国国家自然科学基金; 上海市自然科学基金;
关键词
Mobile edge computing; computation offloading; blockchain; deep reinforcement learning; NETWORKS;
D O I
10.1109/TNET.2023.3274631
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
With the widespread popularity of the Internet of Things and various intelligent medical devices, the amount of medical data is rising sharply, and thus medical data processing has become increasingly challenging. Mobile edge computing technology allows computing power to be allocated at the edge closer to users, which enables efficient data offloading for healthcare systems. However, existing studies on medical data offloading seldom guarantee effective data privacy and security. Moreover, the research equipping data offloading architectures with Blockchain neglect the delay and energy consumption costs incurred in using Blockchain technology for medical data offloading. Therefore, in this paper, we propose a data offloading scheme for healthcare based on Blockchain technology, which achieves optimal medical resource allocation and simultaneously minimizes the cost of offloading tasks. Specifically, we design a smart contract to ensure secure data offloading. And, we formulate the cost problem as a Markov Decision Process, solved by a policy search-based deep reinforcement learning (Asynchronous Advantage Actor-Critic) scheme, where we jointly consider offloading decisions, allocation of computing resources and radio transmission bandwidth, and Blockchain data security audits. The security of our smart-contract-based mechanism is theoretically and empirically proved, while extensive experimental results also show that our solution can obtain superior performance gains with lower cost than other baselines.
引用
收藏
页码:65 / 80
页数:16
相关论文
共 56 条
[31]  
Mao YJ, 2017, INT GEOL REV, V59, P1276, DOI [10.1109/COMST.2017.2745201, 10.1080/00206814.2016.1209435]
[32]   Sleeping Cell Detection for Resiliency Enhancements in 5G/B5G Mobile Edge-Cloud Computing Networks [J].
Ming, Zhao ;
Li, Xiuhua ;
Sun, Chuan ;
Fan, Qilin ;
Wang, Xiaofei ;
Leung, Victor C. M. .
ACM TRANSACTIONS ON SENSOR NETWORKS, 2022, 18 (03)
[33]   Human-level control through deep reinforcement learning [J].
Mnih, Volodymyr ;
Kavukcuoglu, Koray ;
Silver, David ;
Rusu, Andrei A. ;
Veness, Joel ;
Bellemare, Marc G. ;
Graves, Alex ;
Riedmiller, Martin ;
Fidjeland, Andreas K. ;
Ostrovski, Georg ;
Petersen, Stig ;
Beattie, Charles ;
Sadik, Amir ;
Antonoglou, Ioannis ;
King, Helen ;
Kumaran, Dharshan ;
Wierstra, Daan ;
Legg, Shane ;
Hassabis, Demis .
NATURE, 2015, 518 (7540) :529-533
[34]  
Najafabadi M. M., 2022, P 30 AAAI C INT FLAI, V40, P657
[35]   NETWORK RESILIENCE - A MEASURE OF NETWORK FAULT TOLERANCE [J].
NAJJAR, W ;
GAUDIOT, JL .
IEEE TRANSACTIONS ON COMPUTERS, 1990, 39 (02) :174-181
[36]   Joint Communication, Computation, Caching, and Control in Big Data Multi-Access Edge Computing [J].
Ndikumana, Anselme ;
Tran, Nguyen H. ;
Tai Manh Ho ;
Han, Zhu ;
Saad, Walid ;
Niyato, Dusit ;
Hong, Choong Seon .
IEEE TRANSACTIONS ON MOBILE COMPUTING, 2020, 19 (06) :1359-1374
[37]   Secure Computation Offloading in Blockchain Based IoT Networks With Deep Reinforcement Learning [J].
Nguyen, Dinh C. ;
Pathirana, Pubudu N. ;
Ding, Ming ;
Seneviratne, Aruna .
IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2021, 8 (04) :3192-3208
[38]   Federated Learning Meets Blockchain in Edge Computing: Opportunities and Challenges [J].
Nguyen, Dinh C. ;
Ding, Ming ;
Quoc-Viet Pham ;
Pathirana, Pubudu N. ;
Le, Long Bao ;
Seneviratne, Aruna ;
Li, Jun ;
Niyato, Dusit ;
Poor, H. Vincent .
IEEE INTERNET OF THINGS JOURNAL, 2021, 8 (16) :12806-12825
[39]   BEdgeHealth: A Decentralized Architecture for Edge-Based IoMT Networks Using Blockchain [J].
Nguyen, Dinh C. ;
Pathirana, Pubudu N. ;
Ding, Ming ;
Seneviratne, Aruna .
IEEE INTERNET OF THINGS JOURNAL, 2021, 8 (14) :11743-11757
[40]   Privacy-Preserved Task Offloading in Mobile Blockchain With Deep Reinforcement Learning [J].
Nguyen, Dinh C. ;
Pathirana, Pubudu N. ;
Ding, Ming ;
Seneviratne, Aruna .
IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, 2020, 17 (04) :2536-2549