A deep reinforcement learning-based wireless body area network offloading optimization strategy for healthcare services

被引:15
作者
Chen, Yingqun [1 ]
Han, Shaodong [1 ]
Chen, Guihong [1 ,2 ]
Yin, Jiao [3 ]
Wang, Kate Nana [4 ]
Cao, Jinli [5 ]
机构
[1] Guangdong Polytech Normal Univ, Sch Cyber Secur, Guangzhou 510000, Peoples R China
[2] South China Univ Technol, Sch Automat Sci & Engn, Guangzhou 510641, Peoples R China
[3] Victoria Univ, Inst Sustainable Ind & Liveable Cities, Melbourne, Vic 3011, Australia
[4] RMIT Univ, Sch Hlth & Biomed Sci, Melbourne, Vic 3082, Australia
[5] La Trobe Univ, Dept Comp Sci & Informat Technol, Melbourne, Vic 3086, Australia
关键词
Wireless body area networks; Deep reinforcement learning; Offloading policy; Mobile edge computing; RESOURCE-MANAGEMENT; EDGE; INTERNET;
D O I
10.1007/s13755-023-00212-3
中图分类号
R-058 [];
学科分类号
摘要
Wireless body area network (WBAN) is widely adopted in healthcare services, providing remote real-time and continuous healthcare monitoring. With the massive increase of detective sensor data, WBAN is largely restricted by limited storage and computation capacity, resulting in severely decreased efficiency and reliability. Mobile edge computing (MEC) technique can be combined with WBAN to resolve this issue. This paper studies the joint optimization problem of computational offloading and resource allocation (JCORA) in MEC for healthcare service scenarios. We formulate JCORA as a Markov decision process and propose a deep deterministic policy gradient-based WBAN offloading strategy (DDPG-WOS) to optimize time delay and energy consumption in interfered transmission channels. This scheme employs MEC to mitigate the computation pressure on a single WBAN and increase the transmission ability. Further, DDPG-WOS optimizes the offloading strategy-making process by considering the channel condition, transmission quality, computation ability and energy consumption. Simulation results verify the effectiveness of the proposed optimization schema in reducing energy consumption and computation latency and increasing the utility of WBAN compared to two competitive solutions.
引用
收藏
页数:12
相关论文
共 44 条
  • [1] D3PG: Dirichlet DDPG for Task Partitioning and Offloading With Constrained Hybrid Action Space in Mobile-Edge Computing
    Ale, Laha
    King, Scott A.
    Zhang, Ning
    Sattar, Abdul Rahman
    Skandaraniyam, Janahan
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (19) : 19260 - 19272
  • [2] Emerging Edge Computing Technologies for Distributed IoT Systems
    Alnoman, Ali
    Sharma, Shree Krishna
    Ejaz, Waleed
    Anpalagan, Alagan
    [J]. IEEE NETWORK, 2019, 33 (06): : 140 - 147
  • [3] Service-Oriented MEC Applications Placement in a Federated Edge Cloud Architecture
    Brik, Bouziane
    Frangoudis, Pantelis A.
    Ksentini, Adlen
    [J]. ICC 2020 - 2020 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC), 2020,
  • [4] A DRL Agent for Jointly Optimizing Computation Offloading and Resource Allocation in MEC
    Chen, Juan
    Xing, Huanlai
    Xiao, Zhiwen
    Xu, Lexi
    Tao, Tao
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2021, 8 (24) : 17508 - 17524
  • [5] Chen X., 2021, P IEEE 6 INT C CLOUD, P391
  • [6] Deep Reinforcement Learning-Based Dynamic Resource Management for Mobile Edge Computing in Industrial Internet of Things
    Chen, Ying
    Liu, Zhiyong
    Zhang, Yongchao
    Wu, Yuan
    Chen, Xin
    Zhao, Lian
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2021, 17 (07) : 4925 - 4934
  • [7] Neural attention with character embeddings for hay fever detection from twitter
    Du, Jiahua
    Michalska, Sandra
    Subramani, Sudha
    Wang, Hua
    Zhang, Yanchun
    [J]. HEALTH INFORMATION SCIENCE AND SYSTEMS, 2019, 7 (01)
  • [8] Hammood Dalal, 2020, 2020 3rd International Conference on Engineering Technology and its Applications (IICETA), P18, DOI 10.1109/IICETA50496.2020.9318981
  • [9] Deep Q-Learning Technique for Offloading Offline/Online Computation in Blockchain-Enabled Green IoT-Edge Scenarios
    Heidari, Arash
    Jamali, Mohammad Ali Jabraeil
    Navimipour, Nima Jafari
    Akbarpour, Shahin
    [J]. APPLIED SCIENCES-BASEL, 2022, 12 (16):
  • [10] Dynamic Task Offloading in MEC-Enabled IoT Networks: A Hybrid DDPG-D3QN Approach
    Hu, Han
    Wu, Dingguo
    Zhou, Fuhui
    Jin, Shi
    Hu, Rose Qingyang
    [J]. 2021 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2021,