Software-Defined Heterogeneous Edge Computing Network Resource Scheduling Based on Reinforcement Learning

With the rapid development of wireless networks, wireless edge computing networks have been widely considered. The heterogeneous characteristics of the 6G edge computing network bring new challenges to network resource scheduling. In this work, we consider a heterogeneous edge computing network with heterogeneous edge computing nodes and task requirements. We design a software-defined heterogeneous edge computing network architecture to separate the control layer and the data layer. According to different requirements, the tasks in heterogeneous edge computing networks are decomposed into multiple subtasks at the control layer, and the edge computing node alliance responding to the tasks is established to perform the decomposed subtasks. In order to optimize both network energy consumption and network load balancing, we model the resource scheduling problem as a Markov Decision Process (MDP), and design a Proximal Policy Optimization (PPO) resource scheduling algorithm based on deep reinforcement learning. Simulation analysis shows that the proposed PPO resource scheduling can achieve low energy consumption and ideal load balancing.