Multiagent Reinforcement Learning-Based Cooperative Multitype Task Offloading Strategy for Internet of Vehicles in B5G/6G Network
被引:24
作者:
Cui, Yuya
论文数: 0引用数: 0
h-index: 0
机构:
Jiangsu Vocat Coll Informat Technol, Sch Internet Things Engn, Wuxi 214153, Peoples R ChinaJiangsu Vocat Coll Informat Technol, Sch Internet Things Engn, Wuxi 214153, Peoples R China
Cui, Yuya
[1
]
Li, Honghu
论文数: 0引用数: 0
h-index: 0
机构:
Jiangsu Vocat Coll Informat Technol, Business Sch, Wuxi 214153, Peoples R ChinaJiangsu Vocat Coll Informat Technol, Sch Internet Things Engn, Wuxi 214153, Peoples R China
Li, Honghu
[2
]
Zhang, Degan
论文数: 0引用数: 0
h-index: 0
机构:
Tianjin Univ Technol, Tianjin Key Lab Intelligent Comp & Novel Software, Key Lab Comp Vis & Syst, Minist Educ, Tianjin 300384, Peoples R ChinaJiangsu Vocat Coll Informat Technol, Sch Internet Things Engn, Wuxi 214153, Peoples R China
Zhang, Degan
[3
]
Zhu, Aixi
论文数: 0引用数: 0
h-index: 0
机构:
Jiangsu Vocat Coll Informat Technol, Sch Internet Things Engn, Wuxi 214153, Peoples R ChinaJiangsu Vocat Coll Informat Technol, Sch Internet Things Engn, Wuxi 214153, Peoples R China
Zhu, Aixi
[1
]
Li, Yang
论文数: 0引用数: 0
h-index: 0
机构:
Jiangsu Vocat Coll Informat Technol, Sch Internet Things Engn, Wuxi 214153, Peoples R ChinaJiangsu Vocat Coll Informat Technol, Sch Internet Things Engn, Wuxi 214153, Peoples R China
Li, Yang
[1
]
Qiang, Hao
论文数: 0引用数: 0
h-index: 0
机构:
Jiangsu Vocat Coll Informat Technol, Sch Internet Things Engn, Wuxi 214153, Peoples R ChinaJiangsu Vocat Coll Informat Technol, Sch Internet Things Engn, Wuxi 214153, Peoples R China
Qiang, Hao
[1
]
机构:
[1] Jiangsu Vocat Coll Informat Technol, Sch Internet Things Engn, Wuxi 214153, Peoples R China
[2] Jiangsu Vocat Coll Informat Technol, Business Sch, Wuxi 214153, Peoples R China
[3] Tianjin Univ Technol, Tianjin Key Lab Intelligent Comp & Novel Software, Key Lab Comp Vis & Syst, Minist Educ, Tianjin 300384, Peoples R China
B5G/6G;
computation offloading;
Internet of Vehicles (IoV);
multiaccess edge computing (MEC);
multiagent deep reinforcement learning (DRL);
RESOURCE-ALLOCATION;
EDGE;
IOT;
CLOUD;
D O I:
10.1109/JIOT.2023.3245721
中图分类号:
TP [自动化技术、计算机技术];
学科分类号:
0812 ;
摘要:
With the development of intelligent transportation, various computation intensive and delay sensitive applications are emerging in the Internet of Vehicles (IoV). The B5G/6G (Beyond 5th generation mobile communication technology/6th generation mobile communication technology) network has the characteristics of ultralow latency and ultra many connections. The deployment of the network in boxes (NIBs) supporting B5G/6G network in the vehicle can realize the real-time communication with the edge server (ES) and offload the task to the ES. However, the current multiaccess edge computing (MEC) lacks research on cooperative processing among multiple ESs, and the efficiency of data-intensive computation tasks is still insufficient. In this article, we investigate the cooperative offloading of multitype tasks among ESs in B5G/6G networks under a dynamic environment. In order to minimize the delay of task execution, we regard cooperative offloading as a Markov decision process (MDP), and improve the convergence speed and stability of traditional soft actor-critic (SAC) algorithm by the adaptive weight sampling mechanism. Finally, an offline centralized training distributed execution framework based on improved soft actor critical (OCTDE-ISAC) is proposed to optimize the cooperative offloading strategy. The experimental results show that the proposed algorithm is better than the existing algorithm in terms of latency.
引用
收藏
页码:12248 / 12260
页数:13
相关论文
共 48 条
[1]
Beraldi R, 2017, 2017 SECOND INTERNATIONAL CONFERENCE ON FOG AND MOBILE EDGE COMPUTING (FMEC), P94, DOI 10.1109/FMEC.2017.7946414
机构:
Shenzhen Univ, Coll Informat Engn, Shenzhen 518060, Peoples R ChinaShenzhen Univ, Coll Informat Engn, Shenzhen 518060, Peoples R China
Bi, Suzhi
;
Zhang, Ying Jun
论文数: 0引用数: 0
h-index: 0
机构:
Chinese Univ Hong Kong, Dept Informat Engn, Hong Kong, Hong Kong, Peoples R ChinaShenzhen Univ, Coll Informat Engn, Shenzhen 518060, Peoples R China
机构:
Beijing Informat Sci & Technol Univ, Sch Comp Sci, Beijing 100101, Peoples R ChinaBeijing Informat Sci & Technol Univ, Sch Comp Sci, Beijing 100101, Peoples R China
Chen, Ying
;
Zhao, Fengjun
论文数: 0引用数: 0
h-index: 0
机构:
Beijing Informat Sci & Technol Univ, Sch Comp Sci, Beijing 100101, Peoples R ChinaBeijing Informat Sci & Technol Univ, Sch Comp Sci, Beijing 100101, Peoples R China
Zhao, Fengjun
;
Chen, Xin
论文数: 0引用数: 0
h-index: 0
机构:
Beijing Informat Sci & Technol Univ, Sch Comp Sci, Beijing 100101, Peoples R ChinaBeijing Informat Sci & Technol Univ, Sch Comp Sci, Beijing 100101, Peoples R China
Chen, Xin
;
Wu, Yuan
论文数: 0引用数: 0
h-index: 0
机构:
Univ Macau, State Key Lab Internet Things Smart City, Taipa, Macao, Peoples R China
Univ Macau, Dept Comp & Informat Sci, Zhuhai, Peoples R China
Zhuhai Sci & Technol Res Inst, Zhuhai 999078, Peoples R ChinaBeijing Informat Sci & Technol Univ, Sch Comp Sci, Beijing 100101, Peoples R China
机构:
Tianjin Univ Technol, Tianjin 300384, Peoples R China
Jiangsu Vocat Coll Informat Technol, Sch Internet Things Engn, Wuxi 214153, Jiangsu, Peoples R ChinaTianjin Univ Technol, Tianjin 300384, Peoples R China
Cui, Yu-ya
;
Zhang, De-gan
论文数: 0引用数: 0
h-index: 0
机构:
Tianjin Univ Technol, Tianjin 300384, Peoples R ChinaTianjin Univ Technol, Tianjin 300384, Peoples R China
Zhang, De-gan
;
Zhang, Ting
论文数: 0引用数: 0
h-index: 0
机构:
Tianjin Univ Technol, Tianjin 300384, Peoples R ChinaTianjin Univ Technol, Tianjin 300384, Peoples R China
Zhang, Ting
;
Zhang, Jie
论文数: 0引用数: 0
h-index: 0
机构:
Beijing Jiaotong Univ, Sch Elect & Informat Engn, Beijing 100044, Peoples R ChinaTianjin Univ Technol, Tianjin 300384, Peoples R China
Zhang, Jie
;
Piao, Mingjie
论文数: 0引用数: 0
h-index: 0
机构:
Tianjin Univ Technol, Tianjin 300384, Peoples R ChinaTianjin Univ Technol, Tianjin 300384, Peoples R China
机构:
Shenzhen Univ, Coll Informat Engn, Shenzhen 518060, Peoples R ChinaShenzhen Univ, Coll Informat Engn, Shenzhen 518060, Peoples R China
Bi, Suzhi
;
Zhang, Ying Jun
论文数: 0引用数: 0
h-index: 0
机构:
Chinese Univ Hong Kong, Dept Informat Engn, Hong Kong, Hong Kong, Peoples R ChinaShenzhen Univ, Coll Informat Engn, Shenzhen 518060, Peoples R China
机构:
Beijing Informat Sci & Technol Univ, Sch Comp Sci, Beijing 100101, Peoples R ChinaBeijing Informat Sci & Technol Univ, Sch Comp Sci, Beijing 100101, Peoples R China
Chen, Ying
;
Zhao, Fengjun
论文数: 0引用数: 0
h-index: 0
机构:
Beijing Informat Sci & Technol Univ, Sch Comp Sci, Beijing 100101, Peoples R ChinaBeijing Informat Sci & Technol Univ, Sch Comp Sci, Beijing 100101, Peoples R China
Zhao, Fengjun
;
Chen, Xin
论文数: 0引用数: 0
h-index: 0
机构:
Beijing Informat Sci & Technol Univ, Sch Comp Sci, Beijing 100101, Peoples R ChinaBeijing Informat Sci & Technol Univ, Sch Comp Sci, Beijing 100101, Peoples R China
Chen, Xin
;
Wu, Yuan
论文数: 0引用数: 0
h-index: 0
机构:
Univ Macau, State Key Lab Internet Things Smart City, Taipa, Macao, Peoples R China
Univ Macau, Dept Comp & Informat Sci, Zhuhai, Peoples R China
Zhuhai Sci & Technol Res Inst, Zhuhai 999078, Peoples R ChinaBeijing Informat Sci & Technol Univ, Sch Comp Sci, Beijing 100101, Peoples R China
机构:
Tianjin Univ Technol, Tianjin 300384, Peoples R China
Jiangsu Vocat Coll Informat Technol, Sch Internet Things Engn, Wuxi 214153, Jiangsu, Peoples R ChinaTianjin Univ Technol, Tianjin 300384, Peoples R China
Cui, Yu-ya
;
Zhang, De-gan
论文数: 0引用数: 0
h-index: 0
机构:
Tianjin Univ Technol, Tianjin 300384, Peoples R ChinaTianjin Univ Technol, Tianjin 300384, Peoples R China
Zhang, De-gan
;
Zhang, Ting
论文数: 0引用数: 0
h-index: 0
机构:
Tianjin Univ Technol, Tianjin 300384, Peoples R ChinaTianjin Univ Technol, Tianjin 300384, Peoples R China
Zhang, Ting
;
Zhang, Jie
论文数: 0引用数: 0
h-index: 0
机构:
Beijing Jiaotong Univ, Sch Elect & Informat Engn, Beijing 100044, Peoples R ChinaTianjin Univ Technol, Tianjin 300384, Peoples R China
Zhang, Jie
;
Piao, Mingjie
论文数: 0引用数: 0
h-index: 0
机构:
Tianjin Univ Technol, Tianjin 300384, Peoples R ChinaTianjin Univ Technol, Tianjin 300384, Peoples R China