Reinforcement Learning-Based Mobile Offloading for Edge Computing Against Jamming and Interference

被引:133
作者
Xiao, Liang [1 ]
Lu, Xiaozhen [1 ]
Xu, Tangwei [1 ]
Wan, Xiaoyue [1 ]
Ji, Wen [2 ,3 ]
Zhang, Yanyong [4 ]
机构
[1] Xiamen Univ, Dept Informat & Commun Engn, Xiamen 361005, Fujian, Peoples R China
[2] Chinese Acad Sci, Inst Comp Technol, Beijing 100190, Peoples R China
[3] Peng Cheng Lab, Shenzhen 518055, Guangdong, Peoples R China
[4] Univ Sci & Technol China, Sch Comp Sci & Technol, Hefei 230027, Anhui, Peoples R China
基金
北京市自然科学基金; 国家重点研发计划;
关键词
Task analysis; Mobile handsets; Edge computing; Computational modeling; Interference; Energy consumption; Jamming; Mobile offloading; edge computing; interference; jamming; reinforcement learning; WIRELESS CELLULAR NETWORKS; RESOURCE-ALLOCATION; ARCHITECTURE; DEVICES;
D O I
10.1109/TCOMM.2020.3007742
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Mobile edge computing systems help improve the performance of computational-intensive applications on mobile devices and have to resist jamming attacks and heavy interference. In this paper, we present a reinforcement learning based mobile offloading scheme for edge computing against jamming attacks and interference, which uses safe reinforcement learning to avoid choosing the risky offloading policy that fails to meet the computational latency requirements of the tasks. This scheme enables the mobile device to choose the edge device, the transmit power and the offloading rate to improve its utility including the sharing gain, the computational latency, the energy consumption and the signal-to-interference-plus-noise ratio of the offloading signals without knowing the task generation model, the edge computing model, and the jamming/interference model. We also design a deep reinforcement learning based mobile offloading for edge computing that uses an actor network to choose the offloading policy and a critic network to update the actor network weights to improve the computational performance. We discuss the computational complexity and provide the performance bound that consists of the computational latency and the energy consumption based on the Nash equilibrium of the mobile offloading game. Simulation results show that this scheme can reduce the computational latency and save energy consumption.
引用
收藏
页码:6114 / 6126
页数:13
相关论文
共 41 条
[1]  
[Anonymous], 2010, PROC USENIX WORKSHOP
[2]  
[Anonymous], 2016, PROC INT C LEARNING
[3]   Speeding Up Future Video Distribution via Channel-Aware Caching-Aided Coded Multicast [J].
Cacciapuoti, Angela Sara ;
Caleffi, Marcello ;
Ji, Mingyue ;
Llorca, Jaime ;
Tulino, Antonia Maria .
IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2016, 34 (08) :2207-2218
[4]   DATA-DRIVEN COMPUTING AND CACHING IN 5G NETWORKS: ARCHITECTURE AND DELAY ANALYSIS [J].
Chen, Min ;
Qian, Yongfeng ;
Hao, Yixue ;
Li, Yong ;
Song, Jeungeun .
IEEE WIRELESS COMMUNICATIONS, 2018, 25 (01) :70-75
[5]   Optimized Computation Offloading Performance in Virtual Edge Computing Systems via Deep Reinforcement Learning [J].
Chen, Xianfu ;
Zhang, Honggang ;
Wu, Celimuge ;
Mao, Shiwen ;
Ji, Yusheng ;
Bennis, Mehdi .
IEEE INTERNET OF THINGS JOURNAL, 2019, 6 (03) :4005-4018
[6]   Energy-Efficiency Oriented Traffic Offloading in Wireless Networks: A Brief Survey and a Learning Approach for Heterogeneous Cellular Networks [J].
Chen, Xianfu ;
Wu, Jinsong ;
Cai, Yueming ;
Zhang, Honggang ;
Chen, Tao .
IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2015, 33 (04) :627-640
[7]   Efficient Multi-User Computation Offloading for Mobile-Edge Cloud Computing [J].
Chen, Xu ;
Jiao, Lei ;
Li, Wenzhong ;
Fu, Xiaoming .
IEEE-ACM TRANSACTIONS ON NETWORKING, 2016, 24 (05) :2827-2840
[8]   Stochastic Online Learning for Mobile Edge Computing: Learning from Changes [J].
Cui, Qimei ;
Gong, Zhenzhen ;
Ni, Wei ;
Hou, Yanzhao ;
Chen, Xiang ;
Tao, Xiaofeng ;
Zhang, Ping .
IEEE COMMUNICATIONS MAGAZINE, 2019, 57 (03) :63-69
[9]   Femtocaching and Device-to-Device Collaboration: A New Architecture for Wireless Video Distribution [J].
Golrezaei, Negin ;
Molisch, Andreas F. ;
Dimakis, Alexandros G. ;
Caire, Giuseppe .
IEEE COMMUNICATIONS MAGAZINE, 2013, 51 (04) :142-149
[10]   Energy-Efficient Dynamic Computation Offloading and Cooperative Task Scheduling in Mobile Cloud Computing [J].
Guo, Songtao ;
Liu, Jiadi ;
Yang, Yuanyuan ;
Xiao, Bin ;
Li, Zhetao .
IEEE TRANSACTIONS ON MOBILE COMPUTING, 2019, 18 (02) :319-333