DRLR: A Deep-Reinforcement-Learning-Based Recruitment Scheme for Massive Data Collections in 6G-Based IoT Networks

被引:49
作者
Li, Ting [1 ]
Liu, Wei [2 ]
Zeng, Zhiwen [1 ]
Xiong, Neal N. [3 ]
机构
[1] Cent South Univ, Sch Comp Sci & Engn, Changsha 410083, Peoples R China
[2] Hunan Univ Chinese Med, Sch Informat, Changsha 410208, Peoples R China
[3] Northeastern State Univ, Dept Math & Comp Sci, Tahlequah, OK 74464 USA
基金
中国国家自然科学基金;
关键词
Data collection; 6G mobile communication; Internet of Things; Genetic algorithms; Unmanned aerial vehicles; Optimization; Reinforcement learning; 6G; deep reinforcement learning (DRL); massive data collections; unmanned aerial vehicles (UAVs); vehicle; COVERAGE; INTERNET;
D O I
10.1109/JIOT.2021.3067904
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Recently, rapid deployment on the fifth-generation (5G) networks has brought great opportunities for enabling data-intensive applications and brings an extending expectation on the developments of 6G. A basic requirement to develop 6G networks is to reach data with low latency, low cost, and high coverage in smart Internet of Things (IoT). Therefore, this article proposes a novel machine learning-based approach to collect data from multiple sensor devices by cooperation between vehicle and unmanned aerial vehicle (UAV) in IoT. First, a genetic algorithm is utilized to select vehicular collectors to collect massive data from sensor devices, which aims to maximize coverage ratio and to minimize employment cost. Second, we design a novel deep reinforcement learning (DRL)-based route policy to plan collection routes of UAVs with constrain energy, which simplifies the network model, accelerates training speeds, and realizes dynamic planning of flight paths. The optimal collection route of a UAV is a series of outputs based on the proposed DRL-based route policy. Finally, our extensive experiments demonstrate that the proposed scheme can comprehensively improve the coverage ratio of massive data collections and reduce collection costs in smart IoT for the future 6G networks.
引用
收藏
页码:14595 / 14609
页数:15
相关论文
共 45 条
[1]   An efficient parallel genetic algorithm solution for vehicle routing problem in cloud implementation of the intelligent transportation systems [J].
Abbasi, Mahdi ;
Rafiee, Milad ;
Khosravi, Mohammad R. ;
Jolfaei, Alireza ;
Menon, Varun G. ;
Koushyar, Javad Mokhtari .
JOURNAL OF CLOUD COMPUTING-ADVANCES SYSTEMS AND APPLICATIONS, 2020, 9 (01)
[2]   Reputation-Aware, Trajectory-Based Recruitment of Smart Vehicles for Public Sensing [J].
Abdelhamid, Sherin ;
Hassanein, Hossam S. ;
Takahara, Glen .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2018, 19 (05) :1387-1400
[3]  
Al-Dulaimi A., 2018, IEEE COMMUN STAND MA, V2, P72
[4]   Game Theory and Lyapunov Optimization for Cloud-Based Content Delivery Networks With Device-to-Device and UAV-Enabled Caching [J].
Asheralieva, Alia ;
Niyato, Dusit .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2019, 68 (10) :10094-10110
[5]   Joint Position and Travel Path Optimization for Energy Efficient Wireless Data Gathering Using Unmanned Aerial Vehicles [J].
Ben Ghorbel, Mahdi ;
Rodriguez-Duarte, David ;
Ghazzai, Hakim ;
Hossain, Md. Jahangir ;
Menouar, Hamid .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2019, 68 (03) :2165-2175
[6]   Efficient data collection and tracking with flying drones [J].
Caillouet, Christelle ;
Giroire, Frederic ;
Razafindralambo, Tahiry .
AD HOC NETWORKS, 2019, 89 :35-46
[7]   Interference Management for Cellular-Connected UAVs: A Deep Reinforcement Learning Approach [J].
Challita, Ursula ;
Saad, Walid ;
Bettstetter, Christian .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2019, 18 (04) :2125-2140
[8]   Intelligent resource allocation management for vehicles network: An A3C learning approach [J].
Chen, Miaojiang ;
Wang, Tian ;
Ota, Kaoru ;
Dong, Mianxiong ;
Zhao, Ming ;
Liu, Anfeng .
COMPUTER COMMUNICATIONS, 2020, 151 :485-494
[9]   Vision, Requirements, and Technology Trend of 6G: How to Tackle the Challenges of System Coverage, Capacity, User Data-Rate and Movement Speed [J].
Chen, Shanzhi ;
Liang, Ying-Chang ;
Sun, Shaohui ;
Kang, Shaoli ;
Chen, Wenchi ;
Peng, Mugen .
IEEE WIRELESS COMMUNICATIONS, 2020, 27 (02) :218-228
[10]   ITCN: An Intelligent Trust Collaboration Network System in IoT [J].
Guo, Jialin ;
Liu, Anfeng ;
Ota, Kaoru ;
Dong, Mianxiong ;
Deng, Xiaoheng ;
Xiong, Naixue .
IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2022, 9 (01) :203-218