Application of reinforcement learning in UAV cluster task scheduling

被引:70
作者
Yang, Jun [1 ]
You, Xinghui [1 ]
Wu, Gaoxiang [1 ]
Hassan, Mohammad Mehedi [2 ]
Almogren, Ahmad [2 ]
Guna, Joze [3 ]
机构
[1] Huazhong Univ Sci & Technol, Sch Comp Sci & Technol, Wuhan 430074, Hubei, Peoples R China
[2] King Saud Univ, Chair Pervas & Mobile Comp, Coll Comp & Informat Sci, Riyadh 11543, Saudi Arabia
[3] Univ Ljubljana, Fac Elect Engn, Ljubljana 1000, Slovenia
来源
FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE | 2019年 / 95卷
关键词
Reinforcement learning; UAV cluster; Task scheduling; BIG DATA; OPTIMIZATION; PREDICTION;
D O I
10.1016/j.future.2018.11.014
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Recently, unmanned aerial vehicle (UAV) clusters have been widely used in various applications due to its high flexibility, large coverage and reliable transmission efficiency. In order to achieve the collaboration of multiple UAV tasks within a UAV duster, we propose a task-scheduling algorithm based on reinforcement learning in this paper, which enables the UAV to adjust its task strategy automatically and dynamically using its calculation of task performance efficiency. As the UAV needs to perform real-time tasks while working in a dynamic environment without centralized control, it needs to learn tasks according to real time data. Reinforcement learning has the ability to carry out real-time learning and decision making based on the environment, which is an appropriate and feasible method for the task scheduling of UAV clusters. From this perspective, we discuss reinforcement learning that solves the channel allocation problem existing in UAV cluster task scheduling. Finally, this paper also discusses several research problems that may be faced by the further application of UAV cluster task scheduling. (C) 2018 Elsevier B.V. All rights reserved.
引用
收藏
页码:140 / 148
页数:9
相关论文
共 28 条
  • [11] Mobility-Aware Caching and Computation Offloading in 5G Ultra-Dense Cellular Networks
    Chen, Min
    Hao, Yixue
    Qiu, Meikang
    Song, Jeungeun
    Wu, Di
    Humar, Iztok
    [J]. SENSORS, 2016, 16 (07)
  • [12] Itinerary Planning for Energy-Efficient Agent Communications in Wireless Sensor Networks
    Chen, Min
    Yang, Laurence T.
    Kwon, Taekyoung
    Zhou, Liang
    Jo, Minho
    [J]. IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2011, 60 (07) : 3290 - 3299
  • [13] Edge caching with mobility prediction in virtualized LTE mobile networks
    Gomes, Andre S.
    Sousa, Bruno
    Palma, David
    Fonseca, Vitor
    Zhao, Zhongliang
    Monteiro, Edmundo
    Braun, Torsten
    Simoes, Paulo
    Cordeiro, Luis
    [J]. FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2017, 70 : 148 - 162
  • [14] Big Data-Driven Service Composition Using Parallel Clustered Particle Swarm Optimization in Mobile Environment
    Hossain, M. Shamim
    Moniruzzaman, Mohd
    Muhammad, Ghulam
    Ghoneim, Ahmed
    Alamri, Atif
    [J]. IEEE TRANSACTIONS ON SERVICES COMPUTING, 2016, 9 (05) : 806 - 817
  • [15] Hwang K., 2017, Big-Data Analytics for Cloud, IoT and Cognitive Computing
  • [16] Evolutionary task allocation in Internet of Things-based application domains
    Khalil, Enan A.
    Ozdemir, Suat
    Tosun, Suleyman
    [J]. FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2018, 86 : 121 - 133
  • [17] Multi-key privacy-preserving deep learning in cloud computing
    Li, Ping
    Li, Jin
    Huang, Zhengan
    Li, Tong
    Gao, Chong-Zhi
    Yiu, Siu-Ming
    Chen, Kai
    [J]. FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2017, 74 : 76 - 85
  • [18] A UNIFIED CONTROL AND OPTIMIZATION FRAMEWORK FOR DYNAMICAL SERVICE CHAINING IN SOFTWARE-DEFINED NFV SYSTEM
    Li, Yong
    Zheng, Feng
    Chen, Min
    Jin, Depeng
    [J]. IEEE WIRELESS COMMUNICATIONS, 2015, 22 (06) : 15 - 23
  • [19] Software-Defined Network Function Virtualization: A Survey
    Li, Yong
    Chen, Min
    [J]. IEEE ACCESS, 2015, 3 : 2542 - 2553
  • [20] Automatic road detection system for an air-land amphibious car drone
    Li, Yujie
    Lu, Huimin
    Nakayama, Yoshiki
    Kim, Hyoungseop
    Serikawa, Seiichi
    [J]. FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2018, 85 : 51 - 59