Deploying SDN Control in Internet of UAVs: Q-Learning-Based Edge Scheduling

被引:21
作者
Zhang, Chaofeng [1 ]
Dong, Mianxiong [2 ]
Ota, Kaoru [3 ]
机构
[1] Adv Inst Ind Technol, Dept Ind Technol, Tokyo 1400011, Japan
[2] Muroran Inst Technol, Dept Sci & Informat, Muroran, Hokkaido 0508585, Japan
[3] Muroran Inst Technol, Dept Informat & Elect Engn, Muroran, Hokkaido 0508585, Japan
来源
IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT | 2021年 / 18卷 / 01期
关键词
Data collection; Optimization; Resource management; Throughput; Routing; Cloud computing; Production; Softwarized network; wireless networks and cellar networks; machine learning; Internet of Things services; distributed management; DATA-COLLECTION; RESOURCE-MANAGEMENT; IOT; NETWORK; THINGS;
D O I
10.1109/TNSM.2021.3059159
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Nowadays, wilderness monitoring provides massive data output for supporting agricultural production, environmental protection, and disaster monitoring. However, smart upgrading alone for these wireless nodes cannot meet the softwarized network needs today, relating to the explosion of multi-dimensional data and multi-species equipment. In this article, we conduct a comprehensive solution for the UAV based data collection strategy in an "air-to-ground" intelligent softwarized collection system. The innovation in this article is that after using the IoT nodes to complete the data collection process through the proposed bandwidth-weighted traffic pushing optimization (BWPTO) algorithm, the system infers the future changes according to the current network state using a deep Q-learning (DQL) network. Then, by developing the proposed AIIPO (Air-to-Ground Intelligent Information Pushing Optimization) algorithm, the entire network can "forward-looking" the uploaded information to potentially idle nodes in the future, thus achieve the optimized system performance. Through the final mathematical experiments, we prove the optimality of our proposed routing algorithm and forwarding strategy, which are more applicable in the dynamic "air-to-ground" distributed data collection system than other benchmark solutions.
引用
收藏
页码:526 / 537
页数:12
相关论文
共 32 条
  • [1] Affrin K, 2017, 2017 IEEE TECHNOLOGICAL INNOVATIONS IN ICT FOR AGRICULTURE AND RURAL DEVELOPMENT (TIAR), P46, DOI 10.1109/TIAR.2017.8273684
  • [2] Balamurali R, 2015, PROCEEDINGS 2015 IEEE INTERNATIONAL CONFERENCE ON TECHNOLOGICAL INNOVATIONS IN ICT FOR AGRICULTURE AND RURAL DEVELOPMENT TIAR 2015, P156, DOI 10.1109/TIAR.2015.7358549
  • [3] Statistical Analysis of Wireless Traffic: An Adversarial Approach to Drone Surveillance
    Bisio, Igor
    Garibotto, Chiara
    Lavagetto, Fabio
    Levorato, Marco
    Sciarrone, Andrea
    [J]. 2019 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2019,
  • [4] Mean Field Deep Reinforcement Learning for Fair and Efficient UAV Control
    Chen, Dezhi
    Qi, Qi
    Zhuang, Zirui
    Wang, Jingyu
    Liao, Jianxin
    Han, Zhu
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2021, 8 (02) : 813 - 828
  • [5] Data Mining Algorithms for Communication Networks Control: Concepts, Survey and Guidelines
    De Sanctis, Mauro
    Bisio, Igor
    Araniti, Giuseppe
    [J]. IEEE NETWORK, 2016, 30 (01): : 24 - 29
  • [6] Network Slicing for URLLC and eMBB With Max-Matching Diversity Channel Allocation
    dos Santos, Elco Joao, Jr.
    Souza, Richard Demo
    Rebelatto, Joao Luiz
    Alves, Hirley
    [J]. IEEE COMMUNICATIONS LETTERS, 2020, 24 (03) : 658 - 661
  • [7] Gichohi K, 2015, AFRICON
  • [8] MultiSpectralNet: Spectral Clustering Using Deep Neural Network for Multi-View Data
    Huang, Shutting
    Ota, Kaoru
    Dong, Mianxiong
    Li, Fanzhang
    [J]. IEEE TRANSACTIONS ON COMPUTATIONAL SOCIAL SYSTEMS, 2019, 6 (04) : 749 - 760
  • [9] Computer shogi
    Iida, H
    Sakuta, M
    Rollason, J
    [J]. ARTIFICIAL INTELLIGENCE, 2002, 134 (1-2) : 121 - 144
  • [10] Khudadad M, 2014, 17TH IEEE INTERNATIONAL MULTI TOPIC CONFERENCE 2014, P125, DOI 10.1109/INMIC.2014.7097324