LWUAVDet: A Lightweight UAV Object Detection Network on Edge Devices

被引:6
|
作者
Min, Xuanlin [1 ]
Zhou, Wei [1 ]
Hu, Rui [1 ]
Wu, Yinyue [1 ]
Pang, Yiran [2 ]
Yi, Jun [1 ]
机构
[1] Chongqing Univ Sci & Technol, Sch Intelligent Technol & Engn, Chongqing 401331, Peoples R China
[2] Florida Atlantic Univ, Dept Comp & Elect Engn & Comp Sci, Boca Raton, FL 33431 USA
来源
IEEE INTERNET OF THINGS JOURNAL | 2024年 / 11卷 / 13期
基金
中国国家自然科学基金;
关键词
Edge devices; lightweight; object detection; real-time; unmanned aerial vehicles (UAVs);
D O I
10.1109/JIOT.2024.3388045
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Real-time object detection on unmanned aerial vehicles (UAVs) poses a challenging issue due to the limited computing resources of edge devices. To address this problem, we propose a novel lightweight object detection network named LWUAVDet for real-time UAV applications. The detector comprises three core components: E-FPN, PixED Head, and Aux Head. First, we develop an extended and refined topology in the Neck layer, called E-FPN, to enhance the multiscale representation of each stage and alleviate the aliasing effect caused by the repetitive feature fusion of the Neck. Second, we propose a pixel encoder and decoder for dimension exchange between space and channel to achieve flexible and effective feature extraction in the Head layer, named PixED Head. Furthermore, Aux Head for the auxiliary task merely using the Head layer is presented for online distillation to enhance feature representation. Specially, in Aux Head, we introduce the weighted sum of Focal Loss and complete intersection over union loss for the cost matrix of the sample assigner to alleviate category imbalance and aspect ratio imbalance of the UAV data. The performance of our LWUAVDet is validated experimentally on the NVIDIA Jetson Xavier NX and Jetson Nano GPU devices. Extensive experiments demonstrate that the LWUAVDet models achieve a better tradeoff between accuracy and latency on VisDrone, UAVDT, and VOC2012 data sets compared to state-of-the-art lightweight models.
引用
收藏
页码:24013 / 24023
页数:11
相关论文
共 50 条
  • [21] AirSOD: A Lightweight Network for RGB-D Salient Object Detection
    Zeng, Zhihong
    Liu, Haijun
    Chen, Fenglei
    Tan, Xiaoheng
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (03) : 1656 - 1669
  • [22] Lightweight Feature Enhancement Network for Single-Shot Object Detection
    Jia, Peng
    Liu, Fuxiang
    SENSORS, 2021, 21 (04) : 1 - 15
  • [23] Lightweight Object Detection Network Based on Convolutional Neural Network
    Cheng Yequn
    Yan, Wang
    Fan Yuying
    Li Baoqing
    LASER & OPTOELECTRONICS PROGRESS, 2021, 58 (16)
  • [24] EVMNet: Eagle visual mechanism-inspired lightweight network for small object detection in UAV aerial images
    Chen, Xi
    Lin, Chuan
    DIGITAL SIGNAL PROCESSING, 2025, 158
  • [25] A Lightweight Object Detection Framework
    Zhang, Weifeng
    Ni, Jiajia
    Chao, Zhen
    Hu, Qingmao
    2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [26] SyNet: An Ensemble Network for Object Detection in UAV Images
    Albaba, Berat Mert
    Ozer, Sedat
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 10227 - 10234
  • [27] A dual neural network for object detection in UAV images
    Tian, Gangyi
    Liu, Jianran
    Yang, Wenyuan
    NEUROCOMPUTING, 2021, 443 : 292 - 301
  • [28] Lightweight small object detection network with attention mechanism
    Zhu W.
    Wang L.
    Jin Z.
    He D.
    Guangxue Jingmi Gongcheng/Optics and Precision Engineering, 2022, 30 (08): : 998 - 1010
  • [29] YOLO-ELWNet: A lightweight object detection network
    Song, Baoye
    Chen, Jianyu
    Liu, Weibo
    Fang, Jingzhong
    Xue, Yani
    Liu, Xiaohui
    NEUROCOMPUTING, 2025, 636
  • [30] Lightweight Adaptive Feature Selection Network for Object Detection
    Yang A.-P.
    Song S.-Y.
    Cheng S.-M.
    Dongbei Daxue Xuebao/Journal of Northeastern University, 2021, 42 (09): : 1238 - 1245