Deep Reinforcement Learning-Based Resource Allocation for Secure RIS-aided UAV Communication

被引:2
作者
Iqbal, Amjad [1 ]
Al-Habashna, Ala'a [1 ]
Wainer, Gabriel [1 ]
Bouali, Faouzi [2 ]
Boudreau, Gary [3 ]
Wali, Khan [4 ]
机构
[1] Carleton Univ, Dept Syst & Comp Engn, 1125 Colonel Dr, Ottawa, ON K1S 5B6, Canada
[2] Coventry Univ, Ctr Future Transport & Cities, Coventry CV1 5FB, W Midlands, England
[3] Ericsson Canada, 349 Terry Fox Dr, Kanata, ON K2K 2V6, Canada
[4] Wageningen Univ & Res, Agr Biosyst Engn Grp, Wageningen, Netherlands
来源
2023 IEEE 98TH VEHICULAR TECHNOLOGY CONFERENCE, VTC2023-FALL | 2023年
基金
加拿大自然科学与工程研究理事会;
关键词
UAV; RIS; Eavesdropper; Secrecy rate; DRL; INTELLIGENT; OPTIMIZATION; SURFACES;
D O I
10.1109/VTC2023-Fall60731.2023.10333558
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
We investigate the use of reconfigurable intelligent surfaces (RISs) in wireless networks to maximize the sum secrecy rate (i.e., the sum maximum rate that can be communicated under perfect secrecy). Specifically, we focus on a network that utilizes RIS-assisted unmanned aerial vehicles (UAVs) under imperfect channel state information (CSI). Our objective is to maximize the sum secrecy rate while dealing with the presence of multiple eavesdroppers. To achieve this, we jointly optimize the active (UAV) and passive ( RIS) beamforming together with the UAV's trajectories. The formulated problem is non-convex due to the coupling of CSI with the maneuverability of the UAV. To overcome this challenge, we propose a policy-based deep reinforcement learning (DRL) approach that solves the non-convex optimization problem in a centralized fashion. Finally, simulation results show that our proposed approach significantly improves average sum secrecy rates over conventional approaches.
引用
收藏
页数:6
相关论文
共 20 条
[1]   A Deep Learning Based Modeling of Reconfigurable Intelligent Surface Assisted Wireless Communications for Phase Shift Configuration [J].
Sheen B. ;
Yang J. ;
Feng X. ;
Chowdhury M.M.U. .
IEEE Open Journal of the Communications Society, 2021, 2 :262-272
[2]   Energy Efficient Multi-User Communications Aided by Reconfigurable Intelligent Surfaces and UAVs [J].
Diamanti, Maria ;
Tsampazi, Maria ;
Tsiropoulou, Eirini Eleni ;
Papavassiliou, Symeon .
2021 IEEE INTERNATIONAL CONFERENCE ON SMART COMPUTING (SMARTCOMP 2021), 2021, :371-376
[3]   Learning-Aided Realtime Performance Optimisation of Cognitive UAV-Assisted Disaster Communication [J].
Duong, Trung Q. ;
Nguyen, Long D. ;
Hoang Duong Tuan ;
Hanzo, Lajos .
2019 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2019,
[4]   Deep Reinforcement Learning Based Intelligent Reflecting Surface Optimization for MISO Communication Systems [J].
Feng, Keming ;
Wang, Qisheng ;
Li, Xiao ;
Wen, Chao-Kai .
IEEE WIRELESS COMMUNICATIONS LETTERS, 2020, 9 (05) :745-749
[5]   Joint Beamforming and Trajectory Optimization for Intelligent Reflecting Surfaces-Assisted UAV Communications [J].
Ge, Linghui ;
Dong, Peihao ;
Zhang, Hua ;
Wang, Jun-Bo ;
You, Xiaohu .
IEEE ACCESS, 2020, 8 :78702-78712
[6]   Reconfigurable Intelligent Surface Assisted Multiuser MISO Systems Exploiting Deep Reinforcement Learning [J].
Huang, Chongwen ;
Mo, Ronghong ;
Yuen, Chau .
IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2020, 38 (08) :1839-1850
[7]   Reconfigurable Intelligent Surface Assisted UAV Communication: Joint Trajectory Design and Passive Beamforming [J].
Li, Sixian ;
Duo, Bin ;
Yuan, Xiaojun ;
Liang, Ying-Chang ;
Di Renzo, Marco .
IEEE WIRELESS COMMUNICATIONS LETTERS, 2020, 9 (05) :716-720
[8]   Reconfigurable intelligent surfaces for smart wireless environments: channel estimation, system design and applications in 6G networks [J].
Liang, Ying-Chang ;
Chen, Jie ;
Long, Ruizhe ;
He, Zhen-Qing ;
Lin, Xianqi ;
Huang, Chenlu ;
Liu, Shilin ;
Shen, Xuemin ;
Di Renzo, Marco .
SCIENCE CHINA-INFORMATION SCIENCES, 2021, 64 (10)
[9]   Adaptive Beamforming for Uniform Linear Arrays With Unknown Mutual Coupling [J].
Liao, Bin ;
Chan, Shing-Chow .
IEEE ANTENNAS AND WIRELESS PROPAGATION LETTERS, 2012, 11 :464-467
[10]   Enhancing Cellular Communications for UAVs via Intelligent Reflective Surface [J].
Ma, Dong ;
Ding, Ming ;
Hassan, Mahbub .
2020 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE (WCNC), 2020,