Deep Reinforcement Learning-based UAV Control for Optimized Energy Efficiency and Throughput in UAV-assisted Communication

被引:0
作者
Diao, Yuanpeng [1 ]
Hu, Yifan [2 ]
Fu, Junjie [2 ,3 ]
机构
[1] Southeast Univ, Sch Software Engn, Suzhou 215123, Peoples R China
[2] Southeast Univ, Sch Math, Dept Syst Sci, Nanjing 210096, Peoples R China
[3] Purple Mt Labs, Nanjing 211111, Peoples R China
来源
2024 43RD CHINESE CONTROL CONFERENCE, CCC 2024 | 2024年
基金
中国国家自然科学基金;
关键词
Network Throughput; Energy Efficiency; Non-orthogonal Multiple Access; Deep Reinforcement Learning; Unmanned Aerial Vehicle; WIRELESS NETWORKS; DESIGN;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Jointly optimizing throughput and energy in unmanned aerial vehicle (UAV)-assisted networks remains a huge challenge at present. In this work, this problem is addressed with the powerful artificial intelligence method deep reinforcement learning (DRL). A communication model is firstly proposed which incorporates the advanced non-orthogonal multiple access communication technique for dealing with the intra-cluster interference in the network. Then, the optimization problem for jointly optimizing the throughput and energy of the UAV-assisted network considering quality of service (QoS) and other environmental constraints is formulated. Next, a Shared Dueling Deep Q Network (SDuDQN)-based DRL approach is proposed to solve the optimization problem. The simulation results show that the proposed approach can enhance both the throughput and energy efficiency as well as ensuring the spatial and QoS constraints for UAV-assisted networks.
引用
收藏
页码:2530 / 2536
页数:7
相关论文
共 22 条
[1]  
3GPP, 2018, 36777 3GPP TS
[2]  
Ai Lewei, 2023, 2023 42nd Chinese Control Conference (CCC), P8727, DOI 10.23919/CCC58697.2023.10240026
[3]   Interference Management for Cellular-Connected UAVs: A Deep Reinforcement Learning Approach [J].
Challita, Ursula ;
Saad, Walid ;
Bettstetter, Christian .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2019, 18 (04) :2125-2140
[4]   Unsupervised Machine Learning-Based User Clustering in Millimeter-Wave-NOMA Systems [J].
Cui, Jingjing ;
Ding, Zhiguo ;
Fan, Pingzhi ;
Al-Dhahir, Naofal .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2018, 17 (11) :7425-7440
[5]   Optimal User Scheduling and Power Allocation for Millimeter Wave NOMA Systems [J].
Cui, Jingjing ;
Liu, Yuanwei ;
Ding, Zhiguo ;
Fan, Pingzhi ;
Nallanathan, Arumugam .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2018, 17 (03) :1502-1517
[6]   Deep Reinforcement Learning Based Data Collection with Charging Stations [J].
Hao, Fuxin ;
Hu, Yifan ;
Fu, Junjie .
2023 35TH CHINESE CONTROL AND DECISION CONFERENCE, CCDC, 2023, :3344-3349
[7]  
Li YL, 2016, 2016 9TH INTERNATIONAL CONGRESS ON IMAGE AND SIGNAL PROCESSING, BIOMEDICAL ENGINEERING AND INFORMATICS (CISP-BMEI 2016), P1995
[8]   Distributed Energy-Efficient Multi-UAV Navigation for Long-Term Communication Coverage by Deep Reinforcement Learning [J].
Liu, Chi Harold ;
Ma, Xiaoxin ;
Gao, Xudong ;
Tang, Jian .
IEEE TRANSACTIONS ON MOBILE COMPUTING, 2020, 19 (06) :1274-1285
[9]  
Liu X., 2019, IEEE T IND INFORM, P1, DOI DOI 10.1109/TVT.2019.2920284
[10]   Effect of Oxygen Functional Groups on the Surface Properties and Flotation Response of Fine Coal, Comparison of Rank with Oxidation [J].
Lu, Ying ;
Li, Enze ;
Cheng, Huaigang ;
Wang, Xuming ;
Du, Zhiping ;
Cheng, Fangqin ;
Miller, Jan D. .
INTERNATIONAL JOURNAL OF COAL PREPARATION AND UTILIZATION, 2021, 41 (04) :290-306