DRL-Driven Digital Twin Function Virtualization for Adaptive Service Response in 6G Networks

被引:0
作者
Tao, Yihang [1 ]
Wu, Jun [2 ]
Lin, Xi [1 ]
Yang, Wu [3 ]
机构
[1] Shanghai Jiao Tong Univ, Sch Elect Informat & Elect Engn, Shanghai 200240, Peoples R China
[2] Waseda Univ, Grad Sch Informat, Prod & Syst, Fukuoka 8080135, Japan
[3] Harbin Engn Univ, Informat Secur Res Ctr, Harbin 150001, Peoples R China
来源
IEEE NETWORKING LETTERS | 2023年 / 5卷 / 02期
基金
中国国家自然科学基金;
关键词
Digital twins; Servers; 6G mobile communication; Costs; Synchronization; Virtualization; Quality of service; Digital twin networks; function virtualization; 6G service response; deep reinforcement learning; MANAGEMENT;
D O I
10.1109/LNET.2023.3269766
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Digital twin networks (DTN) simulate and predict 6G network behaviors to support innovative 6G services. However, emerging 6G service requests are rapidly growing with dynamic digital twin resource demands, which brings challenges for digital twin resources management with quality of service (QoS) optimization. We propose a novel software-defined DTN architecture with digital twin function virtualization (DTFV) for adaptive 6G service response. Besides, we propose a proximal policy optimization deep reinforcement learning (PPO-DRL) based DTFV resource orchestration algorithm on realizing massive service response quality optimization. Experimental results show that the proposed solution outperforms heuristic digital twin resource management methods.
引用
收藏
页码:125 / 129
页数:5
相关论文
共 10 条
[1]   Toward Tailored Resource Allocation of Slices in 6G Networks With Softwarization and Virtualization [J].
Cao, Haotong ;
Du, Jianbo ;
Zhao, Haitao ;
Luo, Daniel Xiapu ;
Kumar, Neeraj ;
Yang, Longxiang ;
Yu, F. Richard .
IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (09) :6623-6637
[2]  
Chen M., 2021, P IEEE GLOB WORKSH G, P1
[3]   Stochastic Digital-Twin Service Demand With Edge Response: An Incentive-Based Congestion Control Approach [J].
Lin, Xi ;
Wu, Jun ;
Li, Jianhua ;
Yang, Wu ;
Guizani, Mohsen .
IEEE TRANSACTIONS ON MOBILE COMPUTING, 2023, 22 (04) :2402-2416
[4]   Low-Latency Federated Learning and Blockchain for Edge Association in Digital Twin Empowered 6G Networks [J].
Lu, Yunlong ;
Huang, Xiaohong ;
Zhang, Ke ;
Maharjan, Sabita ;
Zhang, Yan .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2021, 17 (07) :5098-5107
[5]   Application-Aware Consensus Management for Software-Defined Intelligent Blockchain in IoT [J].
Wu, Jun ;
Dong, Mianxiong ;
Ota, Kaoru ;
Li, Jianhua ;
Yang, Wu .
IEEE NETWORK, 2020, 34 (01) :69-75
[6]   Big Data Analysis-Based Secure Cluster Management for Optimized Control Plane in Software-Defined Networks [J].
Wu, Jun ;
Dong, Mianxiong ;
Ota, Kaoru ;
Li, Jianhua ;
Guan, Zhitao .
IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, 2018, 15 (01) :27-38
[7]   NFVdeep: Adaptive Online Service Function Chain Deployment with Deep Reinforcement Learning [J].
Xiao, Yikai ;
Zhang, Qixia ;
Liu, Fangming ;
Wang, Jia ;
Zhao, Miao ;
Zhang, Zhongxing ;
Zhang, Jiaxing .
PROCEEDINGS OF THE IEEE/ACM INTERNATIONAL SYMPOSIUM ON QUALITY OF SERVICE (IWQOS 2019), 2019,
[8]   Adaptive Metro Service Schedule and Train Composition With a Proximal Policy Optimization Approach Based on Deep Reinforcement Learning [J].
Ying, Cheng-Shuo ;
Chow, Andy H. F. ;
Wang, Yi-Hui ;
Chin, Kwai-Sang .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (07) :6895-6906
[9]   Adaptive Digital Twin and Multiagent Deep Reinforcement Learning for Vehicular Edge Computing and Networks [J].
Zhang, Ke ;
Cao, Jiayu ;
Zhang, Yan .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2022, 18 (02) :1405-1413
[10]   Intelligent Digital Twin-Based Software-Defined Vehicular Networks [J].
Zhao, Liang ;
Han, Guangjie ;
Li, Zhuhui ;
Shu, Lei .
IEEE NETWORK, 2020, 34 (05) :178-184