Secure Video Offloading in Multi-UAV-Enabled MEC Networks: A Deep Reinforcement Learning Approach

被引:7
作者
Zhao, Tantan [1 ]
Li, Fan [1 ]
He, Lijun [1 ]
机构
[1] Xi An Jiao Tong Univ, Sch Informat & Commun Engn, Shaanxi Key Lab Deep Space Explorat Intelligent In, Xian, Peoples R China
关键词
Deep reinforcement learning (DRL); mobile-edge computing (MEC); secure video offloading; unmanned aerial vehicle (UAV); RESOURCE-ALLOCATION; IOT; OPTIMIZATION; TIME; DRL;
D O I
10.1109/JIOT.2023.3296613
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Unmanned aerial vehicle (UAV)-enabled mobile-edge computing (MEC) has been widely applied in Internet of Things networks while the security risk of wireless computation offloading is still a challenging issue due to the openness nature of line-of-sight wireless channels between UAVs and edge devices (EDs). The existing secure offloading methods are not well targeted for video offloading in multi-UAV-enabled MEC networks since the joint potentiality of video distortion characteristics and multi-UAV flexible deployment in enhancing security is not exploited. In this article, we propose a secure video offloading strategy based on deep reinforcement learning (DRL) for a multi-UAV-enabled MEC system with a UAV eavesdropper. A joint optimization problem of resolution adjustment, offloading decision, computing capability allocation, communication resources orchestration, and multi-UAV position deployment is formulated to minimize system energy consumption under the constraints of offloading security, system latency, and users' quality of experience from the aspect of video frame analytic accuracy. Since the formulated problem is a high-dimensional nonlinear mixed-integer NP-hard problem, it is difficult to obtain the optimal solution via traditional optimization methods. To solve it, we propose a DRL algorithm (HRF-TD3) to instruct the agent to approach the optimal solution efficiently. The simulation results show that the proposed algorithm is superior to comparison algorithms in terms of system energy consumption, EDs' energy consumption, and system latency under the condition of wireless offloading security.
引用
收藏
页码:2950 / 2963
页数:14
相关论文
共 35 条
[1]   Energy-Efficient Computation Offloading for Secure UAV-Edge-Computing Systems [J].
Bai, Tong ;
Wang, Jingjing ;
Ren, Yong ;
Hanzo, Lajos .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2019, 68 (06) :6074-6087
[2]   Joint Resources and Workflow Scheduling in UAV-Enabled Wirelessly-Powered MEC for IoT Systems [J].
Du, Yao ;
Yang, Kun ;
Wang, Kezhi ;
Zhang, Guopeng ;
Zhao, Yizhe ;
Chen, Dongwei .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2019, 68 (10) :10187-10200
[3]   Balancing QoS and Security in the Edge: Existing Practices, Challenges, and 6G Opportunities With Machine Learning [J].
Fadlullah, Zubair Md ;
Mao, Bomin ;
Kato, Nei .
IEEE COMMUNICATIONS SURVEYS AND TUTORIALS, 2022, 24 (04) :2419-2448
[4]   UAV-Aided Energy-Efficient Edge Computing Networks: Security Offloading Optimization [J].
Gu, Xiaohui ;
Zhang, Guoan ;
Wang, Mingxing ;
Duan, Wei ;
Wen, Miaowen ;
Ho, Pin-Han .
IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (06) :4245-4258
[5]   Blockchain-Based Edge Computing Resource Allocation in IoT: A Deep Reinforcement Learning Approach [J].
He, Ying ;
Wang, Yuhang ;
Qiu, Chao ;
Lin, Qiuzhen ;
Li, Jianqiang ;
Ming, Zhong .
IEEE INTERNET OF THINGS JOURNAL, 2021, 8 (04) :2226-2237
[6]  
He Y, 2017, IEEE GLOB COMM CONF
[7]   Integrated Networking, Caching, and Computing for Connected Vehicles: A Deep Reinforcement Learning Approach [J].
He, Ying ;
Zhao, Nan ;
Yin, Hongxi .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2018, 67 (01) :44-55
[8]   Software-Defined Networks with Mobile Edge Computing and Caching for Smart Cities: A Big Data Deep Reinforcement Learning Approach [J].
He, Ying ;
Yu, F. Richard ;
Zhao, Nan ;
Leung, Victor C. M. ;
Yin, Hongxi .
IEEE COMMUNICATIONS MAGAZINE, 2017, 55 (12) :31-37
[9]   Deep-Reinforcement-Learning-Based Optimization for Cache-Enabled Opportunistic Interference Alignment Wireless Networks [J].
He, Ying ;
Zhang, Zheng ;
Yu, F. Richard ;
Zhao, Nan ;
Yin, Hongxi ;
Leung, Victor C. M. ;
Zhang, Yanhua .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2017, 66 (11) :10433-10445
[10]  
Liu Q, 2018, IEEE INFOCOM SER, P756, DOI 10.1109/INFOCOM.2018.8486241