LWUAVDet: A Lightweight UAV Object Detection Network on Edge Devices

被引:6
作者
Min, Xuanlin [1 ]
Zhou, Wei [1 ]
Hu, Rui [1 ]
Wu, Yinyue [1 ]
Pang, Yiran [2 ]
Yi, Jun [1 ]
机构
[1] Chongqing Univ Sci & Technol, Sch Intelligent Technol & Engn, Chongqing 401331, Peoples R China
[2] Florida Atlantic Univ, Dept Comp & Elect Engn & Comp Sci, Boca Raton, FL 33431 USA
来源
IEEE INTERNET OF THINGS JOURNAL | 2024年 / 11卷 / 13期
基金
中国国家自然科学基金;
关键词
Edge devices; lightweight; object detection; real-time; unmanned aerial vehicles (UAVs);
D O I
10.1109/JIOT.2024.3388045
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Real-time object detection on unmanned aerial vehicles (UAVs) poses a challenging issue due to the limited computing resources of edge devices. To address this problem, we propose a novel lightweight object detection network named LWUAVDet for real-time UAV applications. The detector comprises three core components: E-FPN, PixED Head, and Aux Head. First, we develop an extended and refined topology in the Neck layer, called E-FPN, to enhance the multiscale representation of each stage and alleviate the aliasing effect caused by the repetitive feature fusion of the Neck. Second, we propose a pixel encoder and decoder for dimension exchange between space and channel to achieve flexible and effective feature extraction in the Head layer, named PixED Head. Furthermore, Aux Head for the auxiliary task merely using the Head layer is presented for online distillation to enhance feature representation. Specially, in Aux Head, we introduce the weighted sum of Focal Loss and complete intersection over union loss for the cost matrix of the sample assigner to alleviate category imbalance and aspect ratio imbalance of the UAV data. The performance of our LWUAVDet is validated experimentally on the NVIDIA Jetson Xavier NX and Jetson Nano GPU devices. Extensive experiments demonstrate that the LWUAVDet models achieve a better tradeoff between accuracy and latency on VisDrone, UAVDT, and VOC2012 data sets compared to state-of-the-art lightweight models.
引用
收藏
页码:24013 / 24023
页数:11
相关论文
共 50 条
  • [31] A lightweight object detection approach based on edge computing for mining industry
    Hanif, Muhammad Wahab
    Li, Zhanli
    Yu, Zhenhua
    Bashir, Rehmat
    IET IMAGE PROCESSING, 2024, 18 (13) : 4005 - 4022
  • [32] YOLO-Fast: a lightweight object detection model for edge devicesYOLO-Fast: a lightweight object detection model for edge devicesZ. Song et al.
    Zijing Song
    Xiaoyu Zhang
    Panlong Tan
    The Journal of Supercomputing, 81 (5)
  • [33] Adaptive dense pyramid network for object detection in UAV imagery
    Zhang, Ruiqian
    Shao, Zhenfeng
    Huang, Xiao
    Wang, Jiaming
    Wang, Yufeng
    Li, Deren
    NEUROCOMPUTING, 2022, 489 : 377 - 389
  • [34] BiThermalNet: a lightweight network with BNN RPN for thermal object detection
    Yuan, Chunyu
    Agaian, Sos S.
    MULTIMODAL IMAGE EXPLOITATION AND LEARNING 2022, 2022, 12100
  • [35] Pvalite CLN: Lightweight Object Detection with Classfication and Localization Network
    32ND IEEE INTERNATIONAL SYSTEM ON CHIP CONFERENCE (IEEE SOCC 2019), 2019, : 118 - 121
  • [36] On Efficient Object-Detection NAS for ADAS on Edge devices
    Gupta, Diksha
    Lee, Rhui Dih
    Wynter, Laura
    2024 IEEE CONFERENCE ON ARTIFICIAL INTELLIGENCE, CAI 2024, 2024, : 1005 - 1010
  • [37] Object Detection Method Based on Improved YOLO Lightweight Network
    Li Chengyue
    Yao Jianmin
    Lin Zhixian
    Yan Qun
    Fan Baoqing
    LASER & OPTOELECTRONICS PROGRESS, 2020, 57 (14)
  • [38] Lightweight Attention Pyramid Network for Object Detection and Instance Segmentation
    Zhang, Jiwei
    Yan, Yanyu
    Cheng, Zelei
    Wang, Wendong
    APPLIED SCIENCES-BASEL, 2020, 10 (03):
  • [39] FINet: Frequency Injection Network for Lightweight Camouflaged Object Detection
    Liang, Weiyun
    Wu, Jiesheng
    Wu, Yanfeng
    Mu, Xinyue
    Xu, Jing
    IEEE SIGNAL PROCESSING LETTERS, 2024, 31 : 526 - 530
  • [40] A lightweight multidimensional feature network for small object detection on UAVs
    Yang, Wenyuan
    He, Qihan
    Li, Zhongxu
    PATTERN ANALYSIS AND APPLICATIONS, 2025, 28 (01)