DRL-Based Computation Offloading and Resource Allocation in Green MEC-Enabled Maritime-IoT Networks

被引:6
作者
Wei, Ze [1 ]
He, Rongxi [1 ]
Li, Yunuo [1 ]
Song, Chengzhi [1 ]
机构
[1] Dalian Maritime Univ, Coll Informat Sci & Technol, Dalian 116026, Peoples R China
基金
中国国家自然科学基金;
关键词
maritime Internet of things (MIoT); mobile edge computing (MEC); computation offloading; carbon emissions; renewable energy; deep deterministic policy gradient (DDPG); ENERGY;
D O I
10.3390/electronics12244967
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The maritime Internet of Things (MIoT), a maritime version of the Internet of Things (IoT), is envisioned as a promising solution that can provide ubiquitous connectivity over land and sea. Due to the rapid development of maritime activities and the maritime economy, there is a growing demand for computing-intensive and latency-sensitive maritime applications requiring various energy consumption, communication, and computation resources, posing a significant challenge to MIoT devices due to their limited computational ability and battery capacity. Mobile Edge Computing (MEC), which can handle computation tasks at the network's edge more efficiently and with less latency, is emerging as a paradigm for fulfilling the ever-increasing demands of MIoT applications. However, the exponential increase in the number of MIoT devices has increased the system's energy consumption, resulting in increased greenhouse gas emissions and a negative impact on the environment. As a result, it is vital for MIoT networks to take traditional energy usage minimization into account. The integration of renewable energy-harvesting capabilities into base stations or MIoT devices possesses the potential to reduce grid energy consumption and carbon emissions. However, making an effective decision regarding task offloading and resource allocation is crucial for maximizing the utilization of the system's potential resources and minimizing carbon emissions. In this paper, we first propose a green MEC-enabled maritime IoT network architecture to flexibly provide computing-intensive and latency-sensitive applications for MIoT users. Based on the architecture, we formulate the joint task offloading and resource allocation problem by optimizing the total system execution efficiency (including the total size of completed tasks, task execution latency, and the system's carbon emissions) and then propose a deep-deterministic-policy-gradient-based joint optimization strategy to solve the problem, eventually obtaining an effective resolution through continuous action space learning in the changing environment. Finally, simulation results confirm that our proposal can yield good performance in system execution efficiency compared to other benchmarks; that is, it can significantly reduce the system's carbon emissions and tasks' delay and improve the total size of completed tasks.
引用
收藏
页数:27
相关论文
共 48 条
  • [21] GreenEdge: Joint Green Energy Scheduling and Dynamic Task Offloading in Multi-Tier Edge Computing Systems
    Ma, Huirong
    Huang, Peng
    Zhou, Zhi
    Zhang, Xiaoxi
    Chen, Xu
    [J]. IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2022, 71 (04) : 4322 - 4335
  • [22] Reinforcement Learning based Task Offloading and Take-back in Vehicle Platoon Networks
    Ma, Xiaoting
    Zhao, Junhui
    Li, Qiuping
    Gong, Yi
    [J]. 2019 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS WORKSHOPS (ICC WORKSHOPS), 2019,
  • [23] Dynamic Computation Offloading for Mobile-Edge Computing With Energy Harvesting Devices
    Mao, Yuyi
    Zhang, Jun
    Letaief, Khaled B.
    [J]. IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2016, 34 (12) : 3590 - 3605
  • [24] Human-level control through deep reinforcement learning
    Mnih, Volodymyr
    Kavukcuoglu, Koray
    Silver, David
    Rusu, Andrei A.
    Veness, Joel
    Bellemare, Marc G.
    Graves, Alex
    Riedmiller, Martin
    Fidjeland, Andreas K.
    Ostrovski, Georg
    Petersen, Stig
    Beattie, Charles
    Sadik, Amir
    Antonoglou, Ioannis
    King, Helen
    Kumaran, Dharshan
    Wierstra, Daan
    Legg, Shane
    Hassabis, Demis
    [J]. NATURE, 2015, 518 (7540) : 529 - 533
  • [25] Deep reinforcement learning for dynamic computation offloading and resource allocation in cache-assisted mobile edge computing systems
    Nath S.
    Wu J.
    [J]. Intell. Converg. Netw., 2020, 2 (181-198): : 181 - 198
  • [26] A Cooperative Partial Computation Offloading Scheme for Mobile Edge Computing Enabled Internet of Things
    Ning, Zhaolong
    Dong, Peiran
    Kong, Xiangjie
    Xia, Feng
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2019, 6 (03): : 4804 - 4814
  • [27] TANGO: TRAFFIC-AWARE NETWORK PLANNING AND GREEN OPERATION
    Niu, Zhisheng
    [J]. IEEE WIRELESS COMMUNICATIONS, 2011, 18 (05) : 25 - 29
  • [28] A Survey on UAV-Aided Maritime Communications: Deployment Considerations, Applications, and Future Challenges
    Nomikos, Nikolaos
    Gkonis, Panagiotis K.
    Bithas, Petros S.
    Trakadas, Panagiotis
    [J]. IEEE OPEN JOURNAL OF THE COMMUNICATIONS SOCIETY, 2023, 4 : 56 - 78
  • [29] Pasha M., 2018, Int. J. Comput. Netw. Commun, V10, P35, DOI [10.5121/ijcnc.2018.10603, DOI 10.5121/IJCNC.2018.10603]
  • [30] Underwater Internet of Things in Smart Ocean: System Architecture and Open Issues
    Qiu, Tie
    Zhao, Zhao
    Zhang, Tong
    Chen, Chen
    Chen, C. L. Philip
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2020, 16 (07) : 4297 - 4307