Camera-Based Local and Global Target Detection, Tracking, and Localization Techniques for UAVs

被引:6
|
作者
Daramouskas, Ioannis [1 ,2 ]
Meimetis, Dimitrios [1 ]
Patrinopoulou, Niki [1 ]
Lappas, Vaios [3 ]
Kostopoulos, Vassilios [1 ]
Kapoulas, Vaggelis [2 ]
机构
[1] Univ Patras, Appl Mech Lab, Patras 26504, Greece
[2] Comp Technol Inst & Press Diophantus, N Kazantzaki Str Univ Campus, Patras 26504, Greece
[3] Natl Kapodistrian Univ Athens, Dept Aerosp Sci & Technol, Athens 10563, Greece
关键词
YOLO; multi-object detection; target tracking; target localization; UAV; computer vision; deep SORT; SORT;
D O I
10.3390/machines11020315
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Multiple-object detection, localization, and tracking are desirable in many areas and applications, as the field of deep learning has developed and has drawn the attention of academics in computer vision, having a plethora of networks now achieving excellent accuracy in detecting multiple objects in an image. Tracking and localizing objects still remain difficult processes which require significant effort. This work describes an optical camera-based target detection, tracking, and localization solution for Unmanned Aerial Vehicles (UAVs). Based on the well-known network YOLOv4, a custom object detection model was developed and its performance was compared to YOLOv4-Tiny, YOLOv4-608, and YOLOv7-Tiny. The target tracking algorithm we use is based on Deep SORT, providing cutting-edge tracking. The proposed localization approach can accurately determine the position of ground targets identified by the custom object detection model. Moreover, an implementation of a global tracker using localization information from up to four UAV cameras at a time. Finally, a guiding approach is described, which is responsible for providing real-time movement commands for the UAV to follow and cover a designated target. The complete system was evaluated in Gazebo with up to four UAVs utilizing Software-In-The-Loop (SITL) simulation.
引用
收藏
页数:27
相关论文
共 50 条
  • [1] Review of Event Camera-Based Target Detection and Tracking Algorithms
    Qiu, Jiayu
    Zhang, Yasheng
    Fang, Yuqiang
    Li, Pengju
    Zheng, Kaiyuan
    LASER & OPTOELECTRONICS PROGRESS, 2025, 62 (04)
  • [2] A design and simulation of a target detection, tracking and localisation system for UAVs
    Daramouskas, I
    Patrinopoulou, N.
    Meimetis, D.
    Lappas, V
    Kostopoulos, V
    2022 30TH MEDITERRANEAN CONFERENCE ON CONTROL AND AUTOMATION (MED), 2022, : 382 - 388
  • [3] A Camera-Based Target Tracking System for Football Playing Robots
    Stephon, Andrew C.
    Khorbotly, Sami
    2012 44TH SOUTHEASTERN SYMPOSIUM ON SYSTEM THEORY (SSST), 2012, : 164 - 167
  • [4] Camera-Based Tracking of Floating Objects using Fixed-wing UAVs
    Håkon Hagen Helgesen
    Torleiv H. Bryne
    Erik F. Wilthil
    Tor Arne Johansen
    Journal of Intelligent & Robotic Systems, 2021, 102
  • [5] Camera-Based Tracking of Floating Objects using Fixed-wing UAVs
    Helgesen, Hakon Hagen
    Bryne, Torleiv H.
    Wilthil, Erik F.
    Johansen, Tor Arne
    JOURNAL OF INTELLIGENT & ROBOTIC SYSTEMS, 2021, 102 (04)
  • [6] Target Localization and Tracking Method Based on Camera and LiDAR Fusion
    Zhang Pu
    Liu Jinqing
    Xiao Jinchao
    Xiong Junfeng
    Feng Tianwei
    Wang Zhongze
    LASER & OPTOELECTRONICS PROGRESS, 2024, 61 (08)
  • [7] Development of a Mobile Robot with Camera-based Target Tracking and Obstacle Avoidance Systems
    Jamatolail, Mohamed Fitri Mohamad
    Ambar, Radzi
    Abd Wahab, Mohd Helmy
    Isa, Khalid
    Kadir, Herdawatie Abdul
    Ahmad, Muhammad Shukri
    Abd Jamil, Muhammad Mahadi
    Mohammadian, Masoud
    INTERNATIONAL JOURNAL OF INTEGRATED ENGINEERING, 2020, 12 (07): : 236 - 245
  • [8] Cell-Based Target Localization and Tracking with an Active Camera
    You, Ji'an
    Hu, Zhaozheng
    Xiao, Hanbiao
    Xu, Cong
    APPLIED SCIENCES-BASEL, 2022, 12 (06):
  • [9] Probabilistic Target Detection by Camera-Equipped UAVs
    Symington, Andrew
    Waharte, Sonia
    Julier, Simon
    Trigoni, Niki
    2010 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2010, : 4076 - 4081
  • [10] CAMERA-BASED CLEAR PATH DETECTION
    Wu, Qi
    Zhang, Wende
    Chen, Tsuhan
    Kumar, B. V. K. Vijaya
    2010 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2010, : 1874 - 1877