Real-time Single Object Detection on The UAV

被引:0
作者
Wu, Hsiang-Huang [1 ]
Zhou, Zejian [2 ]
Feng, Ming [2 ]
Yan, Yuzhong [1 ]
Xu, Hao [2 ]
Qian, Lijun [1 ]
机构
[1] Texas A&M Univ Syst, Prairie View A&M Univ, Ctr Excellence Res & Educ Big Mil Data Intelligen, Prairie View, TX 77446 USA
[2] Univ Nevada, Dept Elect & Biomed Engn, Reno, NV 89557 USA
来源
2019 INTERNATIONAL CONFERENCE ON UNMANNED AIRCRAFT SYSTEMS (ICUAS' 19) | 2019年
关键词
Computer Vision; Convolutional Neural Network (CNN); Embedded System; UAV; Multi-task Learning;
D O I
10.1109/icuas.2019.8797866
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The demand for mission critical tasks, especially for tracking on the UAVs, has been increasing due to their superior mobility. Out of necessity, the ability of processing large images emerges for object detection or tracking with UAVs. As such, the requirements of low latency and lack of Internet access under some circumstances become the major challenges. In this paper, we present a modeling method of CNN that is dedicated to single object detection on the UAV without any transfer learning model. Not limited to the features learned by the transfer learning model, the single object can be selected arbitrarily and specifically, even can be distinguished from those other objects in the same category. Our modeling method introduces the inducing neural network that follows the traditional CNN and plays the role of guiding the training in a fast and efficient way with respect to the training convergence and the model capacity. Using the dataset released by DAC 2018, which contains 98 classes and 96,408 images taken by UAVs, we present how our modeling method develops the inducing neural network that integrates multi-task learning drawn from the state-of-the-art works to achieve about 50% of IoU (Intersection over Union of the ground-truth bounding boxes and predicted bounding boxes) and 20 FPS running on NVIDIA Jetson TX2. Experimental results demonstrated fast inference of an image in size of 720x1280 and the UAV navigated itself to track the target (car) using the inference result.
引用
收藏
页码:1013 / 1022
页数:10
相关论文
共 50 条
  • [21] Robust object detection with real-time fusion of multiview foreground silhouettes
    Xu, Ming
    Ren, Jie
    Chen, Dongyong
    Smith, Jeremy S.
    Liu, Zhechi
    Jia, Tianyuan
    OPTICAL ENGINEERING, 2012, 51 (04)
  • [22] Deep Learning Based, Real-Time Object Detection for Autonomous Driving
    Akyol, Gamze
    Kantarci, Alperen
    Celik, Ali Eren
    Ak, Abdullah Cihan
    2020 28TH SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE (SIU), 2020,
  • [23] Real-Time Abnormal Object Detection for Video Surveillance in Smart Cities
    Ingle, Palash Yuvraj
    Kim, Young-Gab
    SENSORS, 2022, 22 (10)
  • [24] Real-Time LIDAR from ScanEagle UAV
    Nelson, Roy
    Mastrangelo, John
    von Niederhausern, Kurt
    Fuller, Dan
    GROUND/AIR MULTISENSOR INTEROPERABILITY, INTEGRATION, AND NETWORKING FOR PERSISTENT ISR IX, 2018, 10635
  • [25] Real-Time UAV Trash Monitoring System
    Liao, Yu-Hsien
    Juang, Jih-Gau
    APPLIED SCIENCES-BASEL, 2022, 12 (04):
  • [26] Development of Real-time HABs Detection Technique Using Unmanned Aerial Vehicle (UAV)
    Kim, Tae Woo
    Yun, Hong Sik
    Kim, Kwang Bae
    Hong, Seok Bum
    JOURNAL OF COASTAL RESEARCH, 2019, : 391 - 395
  • [27] Real-time Quadrilateral Object Corner Detection Algorithm Based on Deep Learning
    Zhang, Jinfeng
    Jiao, Zhibin
    An, Xiangjing
    He, Yejun
    2019 COMPUTING, COMMUNICATIONS AND IOT APPLICATIONS (COMCOMAP), 2019, : 70 - 75
  • [28] Depth-assisted rectification for real-time object detection and pose estimation
    Silva do Monte Lima, Joao Paulo
    Magalhaes Simoes, Francisco Paulo
    Uchiyama, Hideaki
    Teichrieb, Veronica
    Marchand, Eric
    MACHINE VISION AND APPLICATIONS, 2016, 27 (02) : 193 - 219
  • [29] Depth-assisted rectification for real-time object detection and pose estimation
    João Paulo Silva do Monte Lima
    Francisco Paulo Magalhães Simões
    Hideaki Uchiyama
    Veronica Teichrieb
    Eric Marchand
    Machine Vision and Applications, 2016, 27 : 193 - 219
  • [30] Real-time evaluation of object detection models across open world scenarios
    Goswami, Puneet
    Aggarwal, Lakshita
    Kumar, Arun
    Kanwar, Rahul
    Vasisht, Urvi
    APPLIED SOFT COMPUTING, 2024, 163