Real-time Single Object Detection on The UAV

被引:0
|
作者
Wu, Hsiang-Huang [1 ]
Zhou, Zejian [2 ]
Feng, Ming [2 ]
Yan, Yuzhong [1 ]
Xu, Hao [2 ]
Qian, Lijun [1 ]
机构
[1] Texas A&M Univ Syst, Prairie View A&M Univ, Ctr Excellence Res & Educ Big Mil Data Intelligen, Prairie View, TX 77446 USA
[2] Univ Nevada, Dept Elect & Biomed Engn, Reno, NV 89557 USA
关键词
Computer Vision; Convolutional Neural Network (CNN); Embedded System; UAV; Multi-task Learning;
D O I
10.1109/icuas.2019.8797866
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The demand for mission critical tasks, especially for tracking on the UAVs, has been increasing due to their superior mobility. Out of necessity, the ability of processing large images emerges for object detection or tracking with UAVs. As such, the requirements of low latency and lack of Internet access under some circumstances become the major challenges. In this paper, we present a modeling method of CNN that is dedicated to single object detection on the UAV without any transfer learning model. Not limited to the features learned by the transfer learning model, the single object can be selected arbitrarily and specifically, even can be distinguished from those other objects in the same category. Our modeling method introduces the inducing neural network that follows the traditional CNN and plays the role of guiding the training in a fast and efficient way with respect to the training convergence and the model capacity. Using the dataset released by DAC 2018, which contains 98 classes and 96,408 images taken by UAVs, we present how our modeling method develops the inducing neural network that integrates multi-task learning drawn from the state-of-the-art works to achieve about 50% of IoU (Intersection over Union of the ground-truth bounding boxes and predicted bounding boxes) and 20 FPS running on NVIDIA Jetson TX2. Experimental results demonstrated fast inference of an image in size of 720x1280 and the UAV navigated itself to track the target (car) using the inference result.
引用
收藏
页码:1013 / 1022
页数:10
相关论文
共 50 条
  • [21] Real-Time Object Detection and Recognition Using Fixed-Wing LALE VTOL UAV
    Sonkar, Sarvesh
    Kumar, Prashant
    George, Riya Catherine
    Yuvaraj, T. P.
    Philip, Deepu
    Ghosh, A. K.
    IEEE SENSORS JOURNAL, 2022, 22 (21) : 20738 - 20747
  • [22] Real-time object detection applied on drones
    Wei, Jingjing
    Zhao, Yiding
    International Agricultural Engineering Journal, 2019, 28 (04): : 450 - 459
  • [23] A real-time object detection algorithm for video
    Lu, Shengyu
    Wang, Beizhan
    Wang, Hongji
    Chen, Lihao
    Ma Linjian
    Zhang, Xiaoyan
    COMPUTERS & ELECTRICAL ENGINEERING, 2019, 77 : 398 - 408
  • [24] Real-Time SSDLite Object Detection on FPGA
    Kim, Suchang
    Na, Seungho
    Kong, Byeong Yong
    Choi, Jaewoong
    Park, In-Cheol
    IEEE TRANSACTIONS ON VERY LARGE SCALE INTEGRATION (VLSI) SYSTEMS, 2021, 29 (06) : 1192 - 1205
  • [25] Real-time detection and tracking of moving object
    Tao, Jianguo
    Yu, Changhong
    2008 INTERNATIONAL SYMPOSIUM ON INTELLIGENT INFORMATION TECHNOLOGY APPLICATION, VOL II, PROCEEDINGS, 2008, : 860 - 863
  • [26] Real-time Object Detection for Streaming Perception
    Yang, Jinrong
    Liu, Songtao
    Li, Zeming
    Li, Xiaoping
    Sun, Jian
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 5375 - 5385
  • [27] Effective real-time visual object detection
    Martin, Francisco
    Veloso, Manuela
    PROGRESS IN ARTIFICIAL INTELLIGENCE, 2012, 1 (04) : 259 - 265
  • [28] Effective real-time visual object detection
    Francisco Martín
    Manuela Veloso
    Progress in Artificial Intelligence, 2012, 1 (4) : 259 - 265
  • [29] Moving object detection for real-time applications
    Maddalena, Lucia
    Petrosino, Alfredo
    14TH INTERNATIONAL CONFERENCE ON IMAGE ANALYSIS AND PROCESSING, PROCEEDINGS, 2007, : 542 - +
  • [30] Real-time UAV Sound Detection and Analysis System
    Kim, Juhyun
    Park, Cheonbok
    Ahn, Jinwoo
    Ko, Youlim
    Park, Junghyun
    Gallagher, John C.
    2017 IEEE SENSORS APPLICATIONS SYMPOSIUM (SAS), 2017,