Real-time Single Object Detection on The UAV

被引:0
|
作者
Wu, Hsiang-Huang [1 ]
Zhou, Zejian [2 ]
Feng, Ming [2 ]
Yan, Yuzhong [1 ]
Xu, Hao [2 ]
Qian, Lijun [1 ]
机构
[1] Texas A&M Univ Syst, Prairie View A&M Univ, Ctr Excellence Res & Educ Big Mil Data Intelligen, Prairie View, TX 77446 USA
[2] Univ Nevada, Dept Elect & Biomed Engn, Reno, NV 89557 USA
关键词
Computer Vision; Convolutional Neural Network (CNN); Embedded System; UAV; Multi-task Learning;
D O I
10.1109/icuas.2019.8797866
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The demand for mission critical tasks, especially for tracking on the UAVs, has been increasing due to their superior mobility. Out of necessity, the ability of processing large images emerges for object detection or tracking with UAVs. As such, the requirements of low latency and lack of Internet access under some circumstances become the major challenges. In this paper, we present a modeling method of CNN that is dedicated to single object detection on the UAV without any transfer learning model. Not limited to the features learned by the transfer learning model, the single object can be selected arbitrarily and specifically, even can be distinguished from those other objects in the same category. Our modeling method introduces the inducing neural network that follows the traditional CNN and plays the role of guiding the training in a fast and efficient way with respect to the training convergence and the model capacity. Using the dataset released by DAC 2018, which contains 98 classes and 96,408 images taken by UAVs, we present how our modeling method develops the inducing neural network that integrates multi-task learning drawn from the state-of-the-art works to achieve about 50% of IoU (Intersection over Union of the ground-truth bounding boxes and predicted bounding boxes) and 20 FPS running on NVIDIA Jetson TX2. Experimental results demonstrated fast inference of an image in size of 720x1280 and the UAV navigated itself to track the target (car) using the inference result.
引用
收藏
页码:1013 / 1022
页数:10
相关论文
共 50 条
  • [31] Real-time Vehicle Detection from UAV Imagery
    Xie, Xuemei
    Yang, Wenzhe
    Cao, Guimei
    Yang, Jianxiu
    Zhao, Zhifu
    Chen, Shu
    Liao, Quan
    Shi, Guangming
    2018 IEEE FOURTH INTERNATIONAL CONFERENCE ON MULTIMEDIA BIG DATA (BIGMM), 2018,
  • [32] Wide-Area and Real-Time Object Search System of UAV
    Li, Xianjiang
    He, Boyong
    Ding, Kaiwen
    Guo, Weijie
    Huang, Bo
    Wu, Liaoni
    REMOTE SENSING, 2022, 14 (05)
  • [33] Training-Set Distillation for Real-Time UAV Object Tracking
    Li, Fan
    Fu, Changhong
    Lin, Fuling
    Li, Yiming
    Lu, Peng
    2020 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2020, : 9715 - 9721
  • [34] A Comparison of Moving Object Detection Methods for Real-Time Moving Object Detection
    Roshan, Aditya
    Zhang, Yun
    AIRBORNE INTELLIGENCE, SURVEILLANCE, RECONNAISSANCE (ISR) SYSTEMS AND APPLICATIONS XI, 2014, 9076
  • [35] Real-Time Condition Monitoring of Transmission Line Insulators Using the YOLO Object Detection Model With a UAV
    Panigrahy, Satyajit
    Karmakar, Subrata
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2024, 73 : 1 - 9
  • [36] ARF-YOLOv8: a novel real-time object detection model for UAV-captured images detection
    Zeng, Yalin
    Guo, Dongjin
    He, Weikai
    Zhang, Tian
    Liu, Zhongtao
    JOURNAL OF REAL-TIME IMAGE PROCESSING, 2024, 21 (04)
  • [37] ESO-DETR: An Improved Real-Time Detection Transformer Model for Enhanced Small Object Detection in UAV Imagery
    Liu, Yingfan
    He, Miao
    Hui, Bin
    DRONES, 2025, 9 (02)
  • [38] Single stage architecture for improved accuracy real-time object detection on mobile devices
    Bacea, Dan-Sebastian
    Oniga, Florin
    IMAGE AND VISION COMPUTING, 2023, 130
  • [39] A modified Single-Shot multibox Detector for beyond Real-Time Object Detection
    Orfanidis, Georgios
    Ioannidis, Konstantinos
    Vrochidis, Stefanos
    Tefas, Anastasios
    Kompatsiaris, Ioannis
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 3977 - 3984
  • [40] Real-time Object detection and Classification for Autonomous Driving
    Naghavi, Seyyed Hamed
    Pourreza, Hamidreza
    2018 8TH INTERNATIONAL CONFERENCE ON COMPUTER AND KNOWLEDGE ENGINEERING (ICCKE), 2018, : 274 - 279