DDQN-Based Trajectory and Resource Optimization for UAV-Aided MEC Secure Communications

被引:8
作者
Ding, Yu [1 ]
Han, Huimei [1 ]
Lu, Weidang [1 ]
Zhao, Nan [3 ]
Wang, Ye [2 ]
Wang, Xianbin [4 ]
Yang, Xiaoniu [1 ]
机构
[1] Zhejiang Univ Technol, Coll Informat Engn, Hangzhou 310023, Peoples R China
[2] Lishui Univ, Fac Engn, Lishui 323000, Peoples R China
[3] Dalian Univ Technol, Sch Informat & Commun Engn, Dalian 116024, Peoples R China
[4] Western Univ, Dept Elect & Comp Engn, London, ON N6A 5B9, Canada
关键词
Double-deep Q-learning (DDQN); mobile edge computing (MEC); secure communications; unmanned aerial vehicle; ALLOCATION; TIME;
D O I
10.1109/TVT.2023.3335210
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Unmanned aerial vehicles (UAVs) have been emerged as cost-effective platforms to extend the coverage of mobile edge computing (MEC) system. However, the broadcast and line-of-sight (LoS) channels in UAV communications create opportunities for malicious eavesdroppers to intercept the offloaded information from ground users, posing a serious challenge to both communication and computing security. In this correspondence, we investigate the problem of secure transmission in UAV-aided MEC systems. Our goal is to maximize the average secure computing capacity by jointly designing the UAV trajectory, time allocation and offloading decision strategy. To this end, we propose a novel double-deep Q-learning (DDQN) based trajectory optimization and resource allocation scheme. Furthermore, the size of the original action space is reduced to boost the convergence of the proposed DDQN-based scheme. Additionally, we design a reward function to navigate the UAV towards its intended destination. Simulation results demonstrate that the proposed DDQN-based scheme outperforms the baselines in terms of average secure computing capacity.
引用
收藏
页码:6006 / 6011
页数:6
相关论文
共 16 条
[1]   Lyapunov-Guided Deep Reinforcement Learning for Stable Online Computation Offloading in Mobile-Edge Computing Networks [J].
Bi, Suzhi ;
Huang, Liang ;
Wang, Hui ;
Zhang, Ying-Jun Angela .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2021, 20 (11) :7519-7537
[2]   Online Edge Learning Offloading and Resource Management for UAV-Assisted MEC Secure Communications [J].
Ding, Yu ;
Feng, Yunqi ;
Lu, Weidang ;
Zheng, Shilian ;
Zhao, Nan ;
Meng, Limin ;
Nallanathan, Arumugam ;
Yang, Xiaoniu .
IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2023, 17 (01) :54-65
[3]   Joint Power and Time Allocation for NOMA-MEC Offloading [J].
Ding, Zhiguo ;
Xu, Jie ;
Dobre, Octavia A. ;
Poor, H. Vincent .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2019, 68 (06) :6207-6211
[4]   UAV-Aided Energy-Efficient Edge Computing Networks: Security Offloading Optimization [J].
Gu, Xiaohui ;
Zhang, Guoan ;
Wang, Mingxing ;
Duan, Wei ;
Wen, Miaowen ;
Ho, Pin-Han .
IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (06) :4245-4258
[5]   UAV-Enhanced Intelligent Offloading for Internet of Things at the Edge [J].
Guo, Hongzhi ;
Liu, Jiajia .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2020, 16 (04) :2737-2746
[6]  
Jia Y.l, 2021, PROC IEEE 5 ADV INF, V21, P2514
[7]  
Li G. Zhu, 2023, IEEE Trans. Wireless Commun., V22, P2022
[8]   Energy-Efficient UAV-Assisted Mobile Edge Computing: Resource Allocation and Trajectory Optimization [J].
Li, Mushu ;
Cheng, Nan ;
Gao, Jie ;
Wang, Yinlu ;
Zhao, Lian ;
Shen, Xuemin .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2020, 69 (03) :3424-3438
[9]   Secure NOMA-Based UAV-MEC Network Towards a Flying Eavesdropper [J].
Lu, Weidang ;
Ding, Yu ;
Gao, Yuan ;
Chen, Yunfei ;
Zhao, Nan ;
Ding, Zhiguo ;
Nallanathan, Arumugam .
IEEE TRANSACTIONS ON COMMUNICATIONS, 2022, 70 (05) :3364-3376
[10]   Optimizing Multi-UAV Deployment in 3-D Space to Minimize Task Completion Time in UAV-Enabled Mobile Edge Computing Systems [J].
Sun, Sujunjie ;
Zhang, Guopeng ;
Mei, Haibo ;
Wang, Kezhi ;
Yang, Kun .
IEEE COMMUNICATIONS LETTERS, 2021, 25 (02) :579-583