A deep reinforcement learning-based wireless body area network offloading optimization strategy for healthcare services

被引:21
作者
Chen, Yingqun [1 ]
Han, Shaodong [1 ]
Chen, Guihong [1 ,2 ]
Yin, Jiao [3 ]
Wang, Kate Nana [4 ]
Cao, Jinli [5 ]
机构
[1] Guangdong Polytech Normal Univ, Sch Cyber Secur, Guangzhou 510000, Peoples R China
[2] South China Univ Technol, Sch Automat Sci & Engn, Guangzhou 510641, Peoples R China
[3] Victoria Univ, Inst Sustainable Ind & Liveable Cities, Melbourne, Vic 3011, Australia
[4] RMIT Univ, Sch Hlth & Biomed Sci, Melbourne, Vic 3082, Australia
[5] La Trobe Univ, Dept Comp Sci & Informat Technol, Melbourne, Vic 3086, Australia
关键词
Wireless body area networks; Deep reinforcement learning; Offloading policy; Mobile edge computing; RESOURCE-MANAGEMENT; EDGE; INTERNET;
D O I
10.1007/s13755-023-00212-3
中图分类号
R-058 [];
学科分类号
摘要
Wireless body area network (WBAN) is widely adopted in healthcare services, providing remote real-time and continuous healthcare monitoring. With the massive increase of detective sensor data, WBAN is largely restricted by limited storage and computation capacity, resulting in severely decreased efficiency and reliability. Mobile edge computing (MEC) technique can be combined with WBAN to resolve this issue. This paper studies the joint optimization problem of computational offloading and resource allocation (JCORA) in MEC for healthcare service scenarios. We formulate JCORA as a Markov decision process and propose a deep deterministic policy gradient-based WBAN offloading strategy (DDPG-WOS) to optimize time delay and energy consumption in interfered transmission channels. This scheme employs MEC to mitigate the computation pressure on a single WBAN and increase the transmission ability. Further, DDPG-WOS optimizes the offloading strategy-making process by considering the channel condition, transmission quality, computation ability and energy consumption. Simulation results verify the effectiveness of the proposed optimization schema in reducing energy consumption and computation latency and increasing the utility of WBAN compared to two competitive solutions.
引用
收藏
页数:12
相关论文
共 44 条
[1]   D3PG: Dirichlet DDPG for Task Partitioning and Offloading With Constrained Hybrid Action Space in Mobile-Edge Computing [J].
Ale, Laha ;
King, Scott A. ;
Zhang, Ning ;
Sattar, Abdul Rahman ;
Skandaraniyam, Janahan .
IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (19) :19260-19272
[2]   Emerging Edge Computing Technologies for Distributed IoT Systems [J].
Alnoman, Ali ;
Sharma, Shree Krishna ;
Ejaz, Waleed ;
Anpalagan, Alagan .
IEEE NETWORK, 2019, 33 (06) :140-147
[3]   Service-Oriented MEC Applications Placement in a Federated Edge Cloud Architecture [J].
Brik, Bouziane ;
Frangoudis, Pantelis A. ;
Ksentini, Adlen .
ICC 2020 - 2020 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC), 2020,
[4]   A DRL Agent for Jointly Optimizing Computation Offloading and Resource Allocation in MEC [J].
Chen, Juan ;
Xing, Huanlai ;
Xiao, Zhiwen ;
Xu, Lexi ;
Tao, Tao .
IEEE INTERNET OF THINGS JOURNAL, 2021, 8 (24) :17508-17524
[5]  
Chen X., 2021, P IEEE 6 INT C CLOUD
[6]   Deep Reinforcement Learning-Based Dynamic Resource Management for Mobile Edge Computing in Industrial Internet of Things [J].
Chen, Ying ;
Liu, Zhiyong ;
Zhang, Yongchao ;
Wu, Yuan ;
Chen, Xin ;
Zhao, Lian .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2021, 17 (07) :4925-4934
[7]   Neural attention with character embeddings for hay fever detection from twitter [J].
Du, Jiahua ;
Michalska, Sandra ;
Subramani, Sudha ;
Wang, Hua ;
Zhang, Yanchun .
HEALTH INFORMATION SCIENCE AND SYSTEMS, 2019, 7 (01)
[8]  
Hammood Dalal, 2020, 2020 3rd International Conference on Engineering Technology and its Applications (IICETA), P18, DOI 10.1109/IICETA50496.2020.9318981
[9]   Deep Q-Learning Technique for Offloading Offline/Online Computation in Blockchain-Enabled Green IoT-Edge Scenarios [J].
Heidari, Arash ;
Jamali, Mohammad Ali Jabraeil ;
Navimipour, Nima Jafari ;
Akbarpour, Shahin .
APPLIED SCIENCES-BASEL, 2022, 12 (16)
[10]   Dynamic Task Offloading in MEC-Enabled IoT Networks: A Hybrid DDPG-D3QN Approach [J].
Hu, Han ;
Wu, Dingguo ;
Zhou, Fuhui ;
Jin, Shi ;
Hu, Rose Qingyang .
2021 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2021,