Reinforcement Learning Based Edge-End Collaboration for Multi-Task Scheduling in 6G Enabled Intelligent Autonomous Transport Systems

被引:7
作者
Li, Peisong [1 ]
Xiao, Ziren [2 ]
Gao, Honghao [3 ]
Wang, Xinheng [2 ]
Wang, Ye [3 ]
机构
[1] Xidian Univ, Hangzhou Inst Technol, Hangzhou 311200, Peoples R China
[2] Xian Jiaotong Liverpool Univ, Sch Adv Technol, Suzhou 215123, Peoples R China
[3] Shanghai Univ, Sch Comp Engn & Sci, Shanghai 200444, Peoples R China
基金
中国国家自然科学基金;
关键词
Processor scheduling; Dynamic scheduling; Optimization; Heuristic algorithms; Vehicle dynamics; Energy consumption; 6G mobile communication; Servers; Multitasking; Resource management; 6G; intelligent autonomous transport systems; vehicular edge computing; proximal policy optimization; multi-task scheduling; RESOURCE-ALLOCATION;
D O I
10.1109/TITS.2024.3525356
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
As communication and computing technologies advance, vehicular edge computing emerges as a promising paradigm for delivering a wide array of intelligent services in 6G enabled Intelligent Autonomous Transport Systems. These service requests, are safety-oriented and typically require the fusion of processing results from multiple independent computation tasks generated by various onboard sensors, in which the computation tasks are delay-sensitive and computation-intensive. Consequently, the allocation of multiple tasks within a single service request while efficiently reducing request completion time and energy consumption presents a substantial challenge. In order to address the problem of multi-task simultaneous scheduling, this paper proposed to employ deep reinforcement learning and edge computing architecture to make task scheduling decisions for vehicles. Firstly, the Vehicle-Infrastructure Network (VINET) is designed, in which the vehicles can assign multiple tasks to the edge servers and other idle vehicles, thus extending the task processing capabilities for vehicles. Secondly, Fully-decentralized Multi-agent Proximal Policy Optimization (FMPPO) algorithm is proposed to make task scheduling decisions for autonomous driving, the large model trained via FMPPO is adaptable to different scenarios with various numbers of vehicles. Thirdly, by taking into account task characteristic, environmental status, and vehicle mobility, the proposed method can make task scheduling decisions in real-time and then dynamically distributes tasks based on the decisions. Finally, experimental results demonstrate that the designed method outperforms benchmark methods in terms of both completion time and energy consumption of computation tasks.
引用
收藏
页数:14
相关论文
共 39 条
[1]   A Joint Resource Allocation, Security with Efficient Task Scheduling in Cloud Computing Using Hybrid Machine Learning Techniques [J].
Bal, Prasanta Kumar ;
Mohapatra, Sudhir Kumar ;
Das, Tapan Kumar ;
Srinivasan, Kathiravan ;
Hu, Yuh-Chung .
SENSORS, 2022, 22 (03)
[2]  
Brockman G, 2016, Arxiv, DOI [arXiv:1606.01540, 10.48550/arXiv.1606.01540, DOI 10.48550/ARXIV.1606.01540]
[3]   Latency-Energy Tradeoff in Connected Autonomous Vehicles: A Deep Reinforcement Learning Scheme [J].
Budhiraja, Ishan ;
Kumar, Neeraj ;
Sharma, Himanshu ;
Elhoseny, Mohamed ;
Lakys, Yahya ;
Rodrigues, Joel J. P. C. .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2023, 24 (11) :13296-13308
[4]   Delay-Optimized V2V-Based Computation Offloading in Urban Vehicular Edge Computing and Networks [J].
Chen, Chen ;
Chen, Lanlan ;
Liu, Lei ;
He, Shunfan ;
Yuan, Xiaoming ;
Lan, Dapeng ;
Chen, Zhuang .
IEEE ACCESS, 2020, 8 :18863-18873
[5]   UAV-Assisted Task Offloading in Vehicular Edge Computing Networks [J].
Dai, Xingxia ;
Xiao, Zhu ;
Jiang, Hongbo ;
Lui, John C. S. .
IEEE TRANSACTIONS ON MOBILE COMPUTING, 2024, 23 (04) :2520-2534
[6]   A review of 6G autonomous intelligent transportation systems: Mechanisms, applications and challenges [J].
Deng, Xiaoheng ;
Wang, Leilei ;
Gui, Jinsong ;
Jiang, Ping ;
Chen, Xuechen ;
Zeng, Feng ;
Wan, Shaohua .
JOURNAL OF SYSTEMS ARCHITECTURE, 2023, 142
[7]   Latency Minimization of Reverse Offloading in Vehicular Edge Computing [J].
Feng, Weiyang ;
Zhang, Ning ;
Li, Shichao ;
Lin, Siyu ;
Ning, Ruirui ;
Yang, Shuzhong ;
Gao, Yuan .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2022, 71 (05) :5343-5357
[8]   PPO2: Location Privacy-Oriented Task Offloading to Edge Computing Using Reinforcement Learning for Intelligent Autonomous Transport Systems [J].
Gao, Honghao ;
Huang, Wanqiu ;
Liu, Tong ;
Yin, Yuyu ;
Li, Youhuizi .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2023, 24 (07) :7599-7612
[9]   Joint Offloading Scheduling and Resource Allocation in Vehicular Edge Computing: A Two Layer Solution [J].
Gao, Jian ;
Kuang, Zhufang ;
Gao, Jie ;
Zhao, Lian .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2023, 72 (03) :3999-4009
[10]  
Kakade S., 2002, ICML, V2, P267