A Reinforcement Learning Approach for Fair User Coverage Using UAV Mounted Base Stations Under Energy Constraints

被引:35
作者
Abeywickrama, Hasini Viranga [1 ]
He, Ying [1 ]
Dutkiewicz, Eryk [1 ]
Jayawickrama, Beeshanga Abewardana [2 ]
Mueck, Markus [3 ]
机构
[1] Univ Technol Sydney, Global Big Data Technol Ctr, Ultimo, NSW 2007, Australia
[2] Ericsson, S-16440 Kista, Sweden
[3] Intel Mobile Commun, D-85579 Neubiber, Germany
来源
IEEE OPEN JOURNAL OF VEHICULAR TECHNOLOGY | 2020年 / 1卷
关键词
Unmanned aerial vehicles (UAVs); wireless coverage; reinforcement learning; 3-D PLACEMENT; NETWORKS; DEPLOYMENT; OPTIMIZATION;
D O I
10.1109/OJVT.2020.2971594
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Unmanned Aerial Vehicles (UAVs) are gaining popularity in many aspects of wireless communication systems. UAV-mounted mobile base stations (UAV-BSs) are an effective and costefficient solution for providing wireless connectivity where fixed infrastructure is not available or destroyed. However, UAV-BSs have their limitations and complications, for instance, limited available energy. In addition, when several UAV-BSs are deployed to provide coverage to a specific area, the possibility of inter-UAV collisions and the interference to ground users increase. We propose Reinforcement Learning (RL) and Deep Reinforcement Learning (DRL) based methods to deploy UAV-BSs under energy constraints to provide efficient and fair coverage to the ground users, while minimising inter-UAV collisions and interference to ground users. The proposed methods outperform the baseline methods by an average increase of 38.94% in system fairness, 42.54% in individual user coverage, and 15.04% in total system coverage, in comparison with the baseline methods.
引用
收藏
页码:67 / 81
页数:15
相关论文
共 38 条
[1]   Potential Field Based Inter-UAV Collision Avoidance Using Virtual Target Relocation [J].
Abeywickrama, Hasini Viranga ;
Jayawickrama, Beeshanga Abewardana ;
He, Ying ;
Dutkiewicz, Eryk .
2018 IEEE 87TH VEHICULAR TECHNOLOGY CONFERENCE (VTC SPRING), 2018,
[2]  
Abeywickrama HV, 2019, IEEE WCNC
[3]   Empirical Power Consumption Model for UAVs [J].
Abeywickrama, Hasini Viranga ;
Jayawickrama, Beeshanga Abewardana ;
He, Ying ;
Dutkiewicz, Eryk .
2018 IEEE 88TH VEHICULAR TECHNOLOGY CONFERENCE (VTC-FALL), 2018,
[4]   Comprehensive Energy Consumption Model for Unmanned Aerial Vehicles, Based on Empirical Studies of Battery Performance [J].
Abeywickrama, Hasini Viranga ;
Jayawickrama, Beeshanga Abewardana ;
He, Ying ;
Dutkiewicz, Eryk .
IEEE ACCESS, 2018, 6 :58383-58394
[5]   Algorithm for Energy Efficient Inter-UAV Collision Avoidance [J].
Abeywickrama, Hasini Viranga ;
Jayawickrama, Beeshanga Abewardana ;
He, Ying ;
Dutkiewicz, Eryk .
2017 17TH INTERNATIONAL SYMPOSIUM ON COMMUNICATIONS AND INFORMATION TECHNOLOGIES (ISCIT), 2017,
[6]   Optimal LAP Altitude for Maximum Coverage [J].
Al-Hourani, Akram ;
Kandeepan, Sithamparanathan ;
Lardner, Simon .
IEEE WIRELESS COMMUNICATIONS LETTERS, 2014, 3 (06) :569-572
[7]   3-D Placement of an Unmanned Aerial Vehicle Base Station for Maximum Coverage of Users With Different QoS Requirements [J].
Alzenad, Mohamed ;
El-Keyi, Amr ;
Yanikomeroglu, Halim .
IEEE WIRELESS COMMUNICATIONS LETTERS, 2018, 7 (01) :38-41
[8]   3-D Placement of an Unmanned Aerial Vehicle Base Station (UAV-BS) for Energy-Efficient Maximal Coverage [J].
Alzenad, Mohamed ;
El-Keyi, Amr ;
Lagum, Faraj ;
Yanikomeroglu, Halim .
IEEE WIRELESS COMMUNICATIONS LETTERS, 2017, 6 (04) :434-437
[9]  
[Anonymous], 2019, QGROUNDCONTROL HOME
[10]   LSwarm: Efficient Collision Avoidance for Large Swarms With Coverage Constraints in Complex Urban Scenes [J].
Arul, Senthil Hariharan ;
Sathyamoor, Adarsh Jagan ;
Patel, Shivang ;
Otte, Michael ;
Xu, Huan ;
Lin, Ming C. ;
Manocha, Dinesh .
IEEE ROBOTICS AND AUTOMATION LETTERS, 2019, 4 (04) :3940-3947