LWUAVDet: A Lightweight UAV Object Detection Network on Edge Devices

被引:6
作者
Min, Xuanlin [1 ]
Zhou, Wei [1 ]
Hu, Rui [1 ]
Wu, Yinyue [1 ]
Pang, Yiran [2 ]
Yi, Jun [1 ]
机构
[1] Chongqing Univ Sci & Technol, Sch Intelligent Technol & Engn, Chongqing 401331, Peoples R China
[2] Florida Atlantic Univ, Dept Comp & Elect Engn & Comp Sci, Boca Raton, FL 33431 USA
来源
IEEE INTERNET OF THINGS JOURNAL | 2024年 / 11卷 / 13期
基金
中国国家自然科学基金;
关键词
Edge devices; lightweight; object detection; real-time; unmanned aerial vehicles (UAVs);
D O I
10.1109/JIOT.2024.3388045
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Real-time object detection on unmanned aerial vehicles (UAVs) poses a challenging issue due to the limited computing resources of edge devices. To address this problem, we propose a novel lightweight object detection network named LWUAVDet for real-time UAV applications. The detector comprises three core components: E-FPN, PixED Head, and Aux Head. First, we develop an extended and refined topology in the Neck layer, called E-FPN, to enhance the multiscale representation of each stage and alleviate the aliasing effect caused by the repetitive feature fusion of the Neck. Second, we propose a pixel encoder and decoder for dimension exchange between space and channel to achieve flexible and effective feature extraction in the Head layer, named PixED Head. Furthermore, Aux Head for the auxiliary task merely using the Head layer is presented for online distillation to enhance feature representation. Specially, in Aux Head, we introduce the weighted sum of Focal Loss and complete intersection over union loss for the cost matrix of the sample assigner to alleviate category imbalance and aspect ratio imbalance of the UAV data. The performance of our LWUAVDet is validated experimentally on the NVIDIA Jetson Xavier NX and Jetson Nano GPU devices. Extensive experiments demonstrate that the LWUAVDet models achieve a better tradeoff between accuracy and latency on VisDrone, UAVDT, and VOC2012 data sets compared to state-of-the-art lightweight models.
引用
收藏
页码:24013 / 24023
页数:11
相关论文
共 50 条
  • [41] SCNet: A Lightweight and Efficient Object Detection Network for Remote Sensing
    Zhu, Shiliang
    Miao, Min
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2024, 21 : 1 - 5
  • [42] An Improved Lightweight Network Using Attentive Feature Aggregation for Object Detection in Autonomous Driving
    Kalgaonkar, Priyank
    El-Sharkawy, Mohamed
    JOURNAL OF LOW POWER ELECTRONICS AND APPLICATIONS, 2023, 13 (03)
  • [43] YOLO-Based Object Detection and Tracking for Autonomous Vehicles Using Edge Devices
    Azevedo, Pedro
    Santos, Vitor
    ROBOT2022: FIFTH IBERIAN ROBOTICS CONFERENCE: ADVANCES IN ROBOTICS, VOL 1, 2023, 589 : 297 - 308
  • [44] YOLO-ERF: lightweight object detector for UAV aerial images
    Wang, Xin
    He, Ning
    Hong, Chen
    Sun, Fengxi
    Han, Wenjing
    Wang, Qi
    MULTIMEDIA SYSTEMS, 2023, 29 (06) : 3329 - 3339
  • [45] YOLO-ERF: lightweight object detector for UAV aerial images
    Xin Wang
    Ning He
    Chen Hong
    Fengxi Sun
    Wenjing Han
    Qi Wang
    Multimedia Systems, 2023, 29 (6) : 3329 - 3339
  • [46] Lightweight Progressive Fusion Calibration Network for Rotated Object Detection in Remote Sensing Images
    Liu, Jing
    Jing, Donglin
    Cao, Yanyan
    Wang, Ying
    Guo, Chaoping
    Shi, Peijun
    Zhang, Haijing
    ELECTRONICS, 2024, 13 (16)
  • [47] LW-YOLOv8: An Lightweight Object Detection Algorithm for UAV Aerial Imagery
    Chen, Hu
    Wang, Dianwei
    Fang, Jie
    Li, Yuanqing
    Xu, Sidi
    Xu, Zhijie
    2024 6TH INTERNATIONAL CONFERENCE ON NATURAL LANGUAGE PROCESSING, ICNLP 2024, 2024, : 446 - 450
  • [48] Surface Defect Detection in Sanitary Ceramics Based on Lightweight Object Detection Network
    Hang, Jingfan
    Sun, Hao
    Yu, Xinghu
    Rodriguez-Andina, Juan J.
    Yang, Xianqiang
    IEEE OPEN JOURNAL OF THE INDUSTRIAL ELECTRONICS SOCIETY, 2022, 3 : 473 - 483
  • [49] LiteYOLO-ID: A Lightweight Object Detection Network for Insulator Defect Detection
    Li, Dahua
    Lu, Yang
    Gao, Qiang
    Li, Xuan
    Yu, Xiao
    Song, Yu
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2024, 73
  • [50] Edge Intelligence Resource Consumption by UAV-based IR Object Detection
    Polukhin, Andrii
    Gordienko, Yuri
    Leier, Mairo
    Jervan, Gert
    Rokovyi, Oleksandr
    Alienin, Oleg
    Stirenko, Sergii
    PROCEEDINGS OF THE 2023 WORKSHOP ON UAVS IN MULTIMEDIA: CAPTURING THE WORLD FROM A NEW PERSPECTIVE, UAVM 2023, 2023, : 57 - 61