Joint Charging Scheduling and Computation Offloading in EV-Assisted Edge Computing: A Safe DRL Approach

被引:16
作者
Zhang, Yongchao [1 ]
Hu, Jia [1 ]
Min, Geyong [1 ]
Chen, Xin [2 ]
Georgalas, Nektarios [3 ]
机构
[1] Univ Exeter, Dept Comp Sci, Exeter EX4 4QF, Devon, England
[2] Beijing Informat Sci & Technol Univ, Comp Sch, Beijing 100101, Peoples R China
[3] British Telecommun PLC, Appl Res Dept, London EC1A 7AJ, England
关键词
Task analysis; Processor scheduling; Optimization; Vehicle dynamics; Charging stations; Oceans; Resource management; Electric vehicles; edge computing; charging scheduling; computation offloading; safe reinforcement learning; ELECTRIC VEHICLES; RESOURCE-ALLOCATION; SYSTEM;
D O I
10.1109/TMC.2024.3355868
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Electric Vehicle-assisted Multi-access Edge Computing (EV-MEC) is a promising paradigm where EVs share their computation resources at the network edge to perform intensive computing tasks while charging. In EV-MEC, a fundamental problem is to jointly decide the charging power of EVs and computation task allocation to EVs, for meeting both the diverse charging demands of EVs and stringent performance requirements of heterogeneous tasks. To address this challenge, we propose a new joint charging scheduling and computation offloading scheme (OCEAN) for EV-MEC. Specifically, we formulate a cooperative two-timescale optimization problem to minimize the charging load and its variance subject to the performance requirements of computation tasks. We then decompose this sophisticated optimization problem into two sub-problems: charging scheduling and computation offloading. For the former, we develop a novel safe deep reinforcement learning (DRL) algorithm, and theoretically prove the feasibility of learned charging scheduling policy. For the latter, we reformulate it as an integer non-linear programming problem to derive the optimal offloading decisions. Extensive experimental results demonstrate that OCEAN can achieve similar performances as the optimal strategy and realize up to 24% improvement in charging load variance over three state-of-the-art algorithms while satisfying the charging demands of all EVs.
引用
收藏
页码:8757 / 8772
页数:16
相关论文
共 57 条
[1]  
[Anonymous], 2017, CVX: Matlab software for disciplined convex programming,
[2]  
Bai QB, 2022, AAAI CONF ARTIF INTE, P3682
[3]   Smart Online Charging Algorithm for Electric Vehicles via Customized Actor-Critic Learning [J].
Cao, Yongsheng ;
Wang, Hao ;
Li, Demin ;
Zhang, Guanglin .
IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (01) :684-694
[4]   Online Scheduling for Hierarchical Vehicle-to-Grid System: Design, Formulation, and Algorithm [J].
Chen, Xiangyu ;
Leung, Ka-Cheong ;
Lam, Albert Y. S. ;
Hill, David. J. .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2019, 68 (02) :1302-1317
[5]   TOFFEE: Task Offloading and Frequency Scaling for Energy Efficiency of Mobile Devices in Mobile Edge Computing [J].
Chen, Ying ;
Zhang, Ning ;
Zhang, Yongchao ;
Chen, Xin ;
Wu, Wen ;
Shen, Xuemin .
IEEE TRANSACTIONS ON CLOUD COMPUTING, 2021, 9 (04) :1634-1644
[6]  
Chow Y, 2018, ADV NEUR IN, V31
[7]  
Chow Y, 2019, Arxiv, DOI arXiv:1901.10031
[8]   Multi-Agent Deep Reinforcement Learning for Joint Decoupled User Association and Trajectory Design in Full-Duplex Multi-UAV Networks [J].
Dai, Chen ;
Zhu, Kun ;
Hossain, Ekram .
IEEE TRANSACTIONS ON MOBILE COMPUTING, 2023, 22 (10) :6056-6070
[9]  
Dalal G, 2018, Arxiv, DOI arXiv:1801.08757
[10]  
Duembgen L, 2010, Arxiv, DOI arXiv:1012.2063