Swarm Reconnaissance Drone System for Real-Time Object Detection Over a Large Area

被引:4
|
作者
Moon, Sungtae [1 ]
Jeon, Jihun [2 ]
Kim, Doyoon [3 ]
Kim, Yongwoo [4 ]
机构
[1] Korea Univ Technol & Educ, Sch Comp Engn, Cheonan Si 31253, South Korea
[2] Inha Univ, Dept Elect & Comp Engn, Incheon 22212, South Korea
[3] Korea Aerosp Res Inst KARI, Deajon 34133, South Korea
[4] Sangmyung Univ, Dept Syst Semicond Engn, Cheonan Si 31066, South Korea
基金
新加坡国家研究基金会;
关键词
Drones; Object detection; Reconnaissance; Real-time systems; Image stitching; Autonomous aerial vehicles; Moon; Aerospace control; network pruning; real-time object detection; swarm flight system; SURVEILLANCE; FLIGHT;
D O I
10.1109/ACCESS.2022.3233841
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Recent developments in drone technology have led to the widespread use of unmanned aerial vehicles (UAVs). In particular, UAVs are often used in reconnaissance to detect objects such as missing persons in large areas. However, traditional systems use only one UAV to search for missing persons in a large area. In addition, object detection is performed after flight or manually because detection requires high computing power. In this paper, a reconnaissance drone system using multiple UAVs is proposed. The proposed multi-UAV reconnaissance system performs real-time object detection on each UAV. The real-time object detection results from each UAV are received by the ground control system (GCS) to stitch the images. To enable real-time object detection in individual UAVs, the filter pruning method is applied to the YOLOv5 model, and the model uses 40% fewer parameters than the existing baseline model. The lightweight YOLOv5 model achieves approximately 11.73 FPS on the Jetson Xaiver NX using a mission computer. Moreover, the proposed image stitching method enables image stitching by effectively matching features using additional information generated by UAVs. The UAV flight tests show that the proposed reconnaissance system can monitor and detect objects in real time over large areas.
引用
收藏
页码:23505 / 23516
页数:12
相关论文
共 50 条
  • [31] Object orientation in the real-time system lifecycle
    Verber, D
    Colnaric, M
    Frigeri, AH
    Halang, WA
    REAL TIME PROGRAMMING 1997: (WRTP 97), 1998, : 59 - 64
  • [32] An embedded architecture for real-time object detection in digital images based on niching particle swarm optimization
    Mehmood, Shahid
    Cagnoni, Stefano
    Mordonini, Monica
    Khan, Shoab Ahmad
    JOURNAL OF REAL-TIME IMAGE PROCESSING, 2015, 10 (01) : 75 - 89
  • [33] Real-Time Object Detection in Remote Sensing Images Based on Embedded System
    Nong Yuanjun
    Wang Junjie
    ACTA OPTICA SINICA, 2021, 41 (10)
  • [34] Platooning control of drones with real-time deep learning object detection
    Dai, Xin
    Nagahara, Masaaki
    ADVANCED ROBOTICS, 2023, 37 (03) : 220 - 225
  • [35] LARNet: Towards Lightweight, Accurate and Real-Time Salient Object Detection
    Wang, Zhenyu
    Zhang, Yunzhou
    Liu, Yan
    Qin, Cao
    Coleman, Sonya A.
    Kerr, Dermot
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 5207 - 5222
  • [36] An embedded architecture for real-time object detection in digital images based on niching particle swarm optimization
    Shahid Mehmood
    Stefano Cagnoni
    Monica Mordonini
    Shoab Ahmad Khan
    Journal of Real-Time Image Processing, 2015, 10 : 75 - 89
  • [37] Real-Time Object Detection and Recognition Using Fixed-Wing LALE VTOL UAV
    Sonkar, Sarvesh
    Kumar, Prashant
    George, Riya Catherine
    Yuvaraj, T. P.
    Philip, Deepu
    Ghosh, A. K.
    IEEE SENSORS JOURNAL, 2022, 22 (21) : 20738 - 20747
  • [38] Real-Time Robust Video Object Detection System Against Physical-World Adversarial Attacks
    Han, Husheng
    Hu, Xing
    Hao, Yifan
    Xu, Kaidi
    Dang, Pucheng
    Wang, Ying
    Zhao, Yongwei
    Du, Zidong
    Guo, Qi
    Wang, Yanzhi
    Zhang, Xishan
    Chen, Tianshi
    IEEE TRANSACTIONS ON COMPUTER-AIDED DESIGN OF INTEGRATED CIRCUITS AND SYSTEMS, 2024, 43 (01) : 366 - 379
  • [39] A RGB-D Based Real-Time Multiple Object Detection and Ranging System for Autonomous Driving
    Yang, Jiachen
    Wang, Chenguang
    Wang, Huihui
    Li, Qiang
    IEEE SENSORS JOURNAL, 2020, 20 (20) : 11959 - 11966
  • [40] An Edge-based Real-Time Object Detection
    Ahmadinia, Ali
    Shah, Jaabaal
    2022 21ST IEEE INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS, ICMLA, 2022, : 465 - 470