Deep reinforcement learning-based edge computing offloading algorithm for software-defined IoT

被引:4
作者
Zhu, Xiaojuan [1 ]
Zhang, Tianhao [1 ]
Zhang, Jinwei [1 ]
Zhao, Bao [1 ]
Zhang, Shunxiang [1 ]
Wu, Cai [1 ]
机构
[1] Anhui Univ Sci & Technol Huainan, Huainan 232001, Peoples R China
基金
中国国家自然科学基金;
关键词
Edge computing; Computing offloading; Software defined network; Internet of things; Deep reinforcement learning;
D O I
10.1016/j.comnet.2023.110006
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Edge computing offloading can effectively solve the problem of insufficient computing resources for terminal devices and improve the performance and efficiency of the system. When network states and tasks change rapidly, data-driven intelligent algorithms have difficulty obtaining comprehensive statistics for accurate pre-diction, resulting in degraded performance of computational offloading and difficulty in adaptive adjustment. It is a current challenge to improve the environment-aware, intelligent optimization so that the computational offloading algorithm can adapt to the dynamic changes in network state and task demands, thus achieving global multi-objective optimization. This paper presents optimized edge computing offloading algorithm for software-defined IoT. First, to provide global state for making decisions, a software defined edge computing (SDEC) architecture is proposed. The edge layer is integrated into the control layer of software-defined IoT, and multiple controllers share the global network state information via east-west message exchange. Moreover, an edge computing offloading algorithm in software-defined IoT (ECO-SDIoT) based on deep reinforcement learning is proposed. It enables the controllers to offload the computing task to the most appropriate edge server according to the global states, task requirements, and reward. Finally, the performance metrics for edge computing offloading were evaluated in terms of unit task processing latency, load balancing of edge servers, task processing energy consumption, and task completion rate, respectively. Simulation results show that ECO-SDIoT can effectively reduce task completion time and energy consumption compared with other strategies.
引用
收藏
页数:15
相关论文
共 42 条
  • [1] Scalability, Consistency, Reliability and Security in SDN Controllers: A Survey of Diverse SDN Controllers
    Ahmad, Suhail
    Mir, Ajaz Hussain
    [J]. JOURNAL OF NETWORK AND SYSTEMS MANAGEMENT, 2021, 29 (01)
  • [2] [Anonymous], 2016, Telecom. Eng. Tech. Stand.
  • [3] Bechhoefer E., 2019, P SOC MACH FAIL PREV
  • [4] An East-West interface for distributed SDN control plane: Implementation and evaluation
    Benamrane, Fouad
    Ben Mamoun, Mouad
    Benaini, Redouane
    [J]. COMPUTERS & ELECTRICAL ENGINEERING, 2017, 57 : 162 - 175
  • [5] Geng Y., 2018, P INT C TESTB RES IN
  • [6] Resource Management Approaches in Fog Computing: a Comprehensive Review
    Ghobaei-Arani, Mostafa
    Souri, Alireza
    Rahmanian, Ali A.
    [J]. JOURNAL OF GRID COMPUTING, 2020, 18 (01) : 1 - 42
  • [7] Traffic Engineering in Hybrid Software Defined Network via Reinforcement Learning
    Guo, Yingya
    Wang, Weipeng
    Zhang, Han
    Guo, Wenzhong
    Wang, Zhiliang
    Tian, Ying
    Yin, Xia
    Wu, Jianping
    [J]. JOURNAL OF NETWORK AND COMPUTER APPLICATIONS, 2021, 189
  • [8] Optimal IoT Service Offloading with Uncertainty in SDN-Based Mobile Edge Computing
    Hao, Huizhen
    Zhang, Jie
    Gu, Qing
    [J]. MOBILE NETWORKS & APPLICATIONS, 2022, 27 (06) : 2318 - 2327
  • [9] A Survey on Software-Defined Network and OpenFlow: From Concept to Implementation
    Hu, Fei
    Hao, Qi
    Bao, Ke
    [J]. IEEE COMMUNICATIONS SURVEYS AND TUTORIALS, 2014, 16 (04): : 2181 - 2206
  • [10] Software-Defined Edge Computing (SDEC): Principle, Open IoT System Architecture, Applications, and Challenges
    Hu, Pengfei
    Chen, Wai
    He, Chunming
    Li, Yiping
    Ning, Huansheng
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2020, 7 (07): : 5934 - 5945