LWUAVDet: A Lightweight UAV Object Detection Network on Edge Devices

被引:6
|
作者
Min, Xuanlin [1 ]
Zhou, Wei [1 ]
Hu, Rui [1 ]
Wu, Yinyue [1 ]
Pang, Yiran [2 ]
Yi, Jun [1 ]
机构
[1] Chongqing Univ Sci & Technol, Sch Intelligent Technol & Engn, Chongqing 401331, Peoples R China
[2] Florida Atlantic Univ, Dept Comp & Elect Engn & Comp Sci, Boca Raton, FL 33431 USA
来源
IEEE INTERNET OF THINGS JOURNAL | 2024年 / 11卷 / 13期
基金
中国国家自然科学基金;
关键词
Edge devices; lightweight; object detection; real-time; unmanned aerial vehicles (UAVs);
D O I
10.1109/JIOT.2024.3388045
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Real-time object detection on unmanned aerial vehicles (UAVs) poses a challenging issue due to the limited computing resources of edge devices. To address this problem, we propose a novel lightweight object detection network named LWUAVDet for real-time UAV applications. The detector comprises three core components: E-FPN, PixED Head, and Aux Head. First, we develop an extended and refined topology in the Neck layer, called E-FPN, to enhance the multiscale representation of each stage and alleviate the aliasing effect caused by the repetitive feature fusion of the Neck. Second, we propose a pixel encoder and decoder for dimension exchange between space and channel to achieve flexible and effective feature extraction in the Head layer, named PixED Head. Furthermore, Aux Head for the auxiliary task merely using the Head layer is presented for online distillation to enhance feature representation. Specially, in Aux Head, we introduce the weighted sum of Focal Loss and complete intersection over union loss for the cost matrix of the sample assigner to alleviate category imbalance and aspect ratio imbalance of the UAV data. The performance of our LWUAVDet is validated experimentally on the NVIDIA Jetson Xavier NX and Jetson Nano GPU devices. Extensive experiments demonstrate that the LWUAVDet models achieve a better tradeoff between accuracy and latency on VisDrone, UAVDT, and VOC2012 data sets compared to state-of-the-art lightweight models.
引用
收藏
页码:24013 / 24023
页数:11
相关论文
共 50 条
  • [1] A Lightweight Border Patrol Object Detection Network for Edge Devices
    Yue, Lei
    Ling, Haifeng
    Yuan, Jianhu
    Bai, Linyuan
    ELECTRONICS, 2022, 11 (22)
  • [2] LODNU: lightweight object detection network in UAV vision
    Naiyuan Chen
    Yan Li
    Zhuomin Yang
    Zhensong Lu
    Sai Wang
    Junang Wang
    The Journal of Supercomputing, 2023, 79 : 10117 - 10138
  • [3] LODNU: lightweight object detection network in UAV vision
    Chen, Naiyuan
    Li, Yan
    Yang, Zhuomin
    Lu, Zhensong
    Wang, Sai
    Wang, Junang
    JOURNAL OF SUPERCOMPUTING, 2023, 79 (09) : 10117 - 10138
  • [4] A new lightweight network for efficient UAV object detection
    Hua, Wei
    Chen, Qili
    Chen, Wenbai
    SCIENTIFIC REPORTS, 2024, 14 (01):
  • [5] A comprehensive survey of deep learning-based lightweight object detection models for edge devices
    Mittal, Payal
    ARTIFICIAL INTELLIGENCE REVIEW, 2024, 57 (09)
  • [6] LIGHTDET: A LIGHTWEIGHT AND ACCURATE OBJECT DETECTION NETWORK
    Tang, Qiankun
    Li, Jie
    Shi, Zhiping
    Hu, Yu
    2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2020, : 2243 - 2247
  • [7] LUMF-YOLO: a lightweight object detection network integrating UAV motion features
    Wang, Sicheng
    Li, Gang
    He, Bin
    Cheng, Bin
    Ding, Yulong
    Li, Wei
    COMPUTING, 2025, 107 (01)
  • [8] Fast and Lightweight Object Detection Network: Detection and Recognition on Resource Constrained Devices
    Godinho De Oliveira, Bernardo Augusto
    Freitas Ferreira, Flavia Magalhaes
    Paiva Da Silva Martins, Carlos Augusto
    IEEE ACCESS, 2018, 6 : 8714 - 8724
  • [9] RPDet: a re-parameterized efficient object detection network for UAV edge platforms
    Buhong Zhang
    Zhigang Wang
    Meibo Lv
    Xiaodong Liu
    Lei Zhang
    Journal of Real-Time Image Processing, 2025, 22 (3)
  • [10] A Robust and Efficient Multiscenario Object Detection Network for Edge Devices
    Chen, Zhihuan
    Luo, Aiwen
    Ding, Lin
    Zheng, Jialu
    Huang, Zunkai
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2025, 22