Swarm Reconnaissance Drone System for Real-Time Object Detection Over a Large Area

被引:4
|
作者
Moon, Sungtae [1 ]
Jeon, Jihun [2 ]
Kim, Doyoon [3 ]
Kim, Yongwoo [4 ]
机构
[1] Korea Univ Technol & Educ, Sch Comp Engn, Cheonan Si 31253, South Korea
[2] Inha Univ, Dept Elect & Comp Engn, Incheon 22212, South Korea
[3] Korea Aerosp Res Inst KARI, Deajon 34133, South Korea
[4] Sangmyung Univ, Dept Syst Semicond Engn, Cheonan Si 31066, South Korea
基金
新加坡国家研究基金会;
关键词
Drones; Object detection; Reconnaissance; Real-time systems; Image stitching; Autonomous aerial vehicles; Moon; Aerospace control; network pruning; real-time object detection; swarm flight system; SURVEILLANCE; FLIGHT;
D O I
10.1109/ACCESS.2022.3233841
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Recent developments in drone technology have led to the widespread use of unmanned aerial vehicles (UAVs). In particular, UAVs are often used in reconnaissance to detect objects such as missing persons in large areas. However, traditional systems use only one UAV to search for missing persons in a large area. In addition, object detection is performed after flight or manually because detection requires high computing power. In this paper, a reconnaissance drone system using multiple UAVs is proposed. The proposed multi-UAV reconnaissance system performs real-time object detection on each UAV. The real-time object detection results from each UAV are received by the ground control system (GCS) to stitch the images. To enable real-time object detection in individual UAVs, the filter pruning method is applied to the YOLOv5 model, and the model uses 40% fewer parameters than the existing baseline model. The lightweight YOLOv5 model achieves approximately 11.73 FPS on the Jetson Xaiver NX using a mission computer. Moreover, the proposed image stitching method enables image stitching by effectively matching features using additional information generated by UAVs. The UAV flight tests show that the proposed reconnaissance system can monitor and detect objects in real time over large areas.
引用
收藏
页码:23505 / 23516
页数:12
相关论文
共 50 条
  • [21] Enabling real-time object detection on low cost FPGAs
    Jain, Vikram
    Jadhav, Ninad
    Verhelst, Marian
    JOURNAL OF REAL-TIME IMAGE PROCESSING, 2022, 19 (01) : 217 - 229
  • [22] Enabling real-time object detection on low cost FPGAs
    Vikram Jain
    Ninad Jadhav
    Marian Verhelst
    Journal of Real-Time Image Processing, 2022, 19 : 217 - 229
  • [23] Real-Time Adaptive Object Detection and Tracking for Autonomous Vehicles
    Hoffmann, Joao Eduardo
    Tosso, Hilkija Gaius
    Dias Santos, Max Mauro
    Justo, Joao Francisco
    Malik, Asad Waqar
    Rahman, Anis Ur
    IEEE TRANSACTIONS ON INTELLIGENT VEHICLES, 2021, 6 (03): : 450 - 459
  • [24] A real-time object detection algorithm for video
    Lu, Shengyu
    Wang, Beizhan
    Wang, Hongji
    Chen, Lihao
    Ma Linjian
    Zhang, Xiaoyan
    COMPUTERS & ELECTRICAL ENGINEERING, 2019, 77 : 398 - 408
  • [25] Real-Time SSDLite Object Detection on FPGA
    Kim, Suchang
    Na, Seungho
    Kong, Byeong Yong
    Choi, Jaewoong
    Park, In-Cheol
    IEEE TRANSACTIONS ON VERY LARGE SCALE INTEGRATION (VLSI) SYSTEMS, 2021, 29 (06) : 1192 - 1205
  • [26] Real-Time and Accurate Drone Detection in a Video with a Static Background
    Seidaliyeva, Ulzhalgas
    Akhmetov, Daryn
    Ilipbayeva, Lyazzat
    Matson, Eric T.
    SENSORS, 2020, 20 (14) : 1 - 18
  • [27] Real-time object detection applied on drones
    Wei, Jingjing
    Zhao, Yiding
    International Agricultural Engineering Journal, 2019, 28 (04): : 450 - 459
  • [28] Enhancing Real-Time Object Detection With Optical Flow-Guided Streaming Perception
    Wang, Tongbo
    Zhu, Lin
    Huang, Hua
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2025, 35 (05) : 4816 - 4830
  • [29] Region Boosting for Real-Time Object Detection Using Multi-Dimensional Attention
    Chen, Jinlong
    Xu, Kejian
    Ning, Yi
    Xu, Zhi
    IEEE ACCESS, 2024, 12 : 171634 - 171643
  • [30] Convolutional Neural Network-Based Real-Time Object Detection and Tracking for Parrot AR Drone 2
    Rohan, Ali
    Rabah, Mohammed
    Kim, Sung-Ho
    IEEE ACCESS, 2019, 7 : 69575 - 69584