Robust Aerial Person Detection With Lightweight Distillation Network for Edge Deployment

被引:4
作者
Zhang, Xiangqing [1 ,2 ]
Feng, Yan [1 ]
Zhang, Shun [1 ]
Wang, Nan [1 ]
Lu, Guohua [3 ]
Mei, Shaohui [1 ]
机构
[1] Northwestern Polytech Univ, Sch Elect & Informat, Xian 710129, Peoples R China
[2] Yanan Univ, Coll Math & Comp Sci, Yanan 716000, Peoples R China
[3] Air Force Med Univ, Dept Mil Biomed Engn, Xian 710032, Shaanxi, Peoples R China
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2024年 / 62卷
基金
中国国家自然科学基金;
关键词
Computational modeling; Quantization (signal); Accuracy; Feature extraction; Detectors; Image edge detection; Avalanche photodiodes; Aerial person detection (APD); distillation network; pluggable tracker; quantization awareness; OBJECT DETECTION;
D O I
10.1109/TGRS.2024.3421310
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Aerial person detection (APD) is vital for enhancing search and rescue (SaR) operations, particularly when locating victims in remote, poorly-lit areas. Despite advancements in detection technologies, achieving a balance between detection speed and accuracy on mobile devices in "edge AI" continues to pose challenges. In this article, a lightweight distillation network (APDNet) is proposed for edge deployment of APD, which enables real-time inference as well as minimizes accuracy loss during model transfer. The proposed APDNet employs a distillation network between varying-depth backbones and integrates an 8-bit quantized optimizer to reduce the floating-point operations of network parameters. Specifically, in the teach-assistant distillation (TAD) stage, small student models using random weight initialization are trained with pseudo-labels generated by deeper teacher models, facilitating consistent learning for a more accurate, lighter model. Moreover, a low-precision quantization (LPQ) stage incorporates an offline, quantization-aware training strategy that dynamically adjusts the ranges of weight and activation function float-point values, reducing computational complexity. In order to compensate for the potential accuracy decline, a pluggable tracker updates the position and feature information of persons frame-by-frame, with tracking results integrated with detection outputs to enhance accuracy. Extensive experiments on the Heridal, Manipal-UAV, and VTSaR datasets confirm the effectiveness of APDNet, demonstrating its superior performance in edge-based APD.
引用
收藏
页数:16
相关论文
共 66 条
  • [1] Manipal-UAV person detection dataset: A step towards benchmarking dataset and algorithms for small object detection
    Akshatha, K. R.
    Karunakar, A. K.
    Shenoy, B. Satish
    Pavan, K. Phani
    Dhareshwar, Chinmay V.
    Johnson, Dennis George
    [J]. ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2023, 195 : 77 - 89
  • [2] Densely Distilled Flow-Based Knowledge Transfer in Teacher-Student Framework for Image Classification
    Bae, Ji-Hoon
    Yeo, Doyeob
    Yim, Junho
    Kim, Nae-Soo
    Pyo, Cheol-Sig
    Kim, Junmo
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 : 5698 - 5710
  • [3] Bewley A, 2016, IEEE IMAGE PROC, P3464, DOI 10.1109/ICIP.2016.7533003
  • [4] Deep Learning Approach in Aerial Imagery for Supporting Land Search and Rescue Missions
    Bozic-Stulic, Dunja
    Marusic, Zeljko
    Gotovac, Sven
    [J]. INTERNATIONAL JOURNAL OF COMPUTER VISION, 2019, 127 (09) : 1256 - 1278
  • [5] AQD: Towards Accurate Quantized Object Detection
    Chen, Peng
    Liu, Jing
    Zhuang, Bohan
    Tan, Mingkui
    Shen, Chunhua
    [J]. 2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 104 - 113
  • [6] Holistic Prototype Activation for Few-Shot Segmentation
    Cheng, Gong
    Lang, Chunbo
    Han, Junwei
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (04) : 4650 - 4666
  • [7] General Instance Distillation for Object Detection
    Dai, Xing
    Jiang, Zeren
    Wu, Zhao
    Bao, Yiping
    Wang, Zhicheng
    Liu, Si
    Zhou, Erjin
    [J]. 2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 7838 - 7847
  • [8] Dettmers T, 2022, Arxiv, DOI arXiv:2110.02861
  • [9] Ding XH, 2021, Arxiv, DOI arXiv:2101.03697
  • [10] VisDrone-DET2019: The Vision Meets Drone Object Detection in Image Challenge Results
    Du, Dawei
    Zhu, Pengfei
    Wen, Longyin
    Bian, Xiao
    Ling, Haibin
    Hu, Qinghua
    Peng, Tao
    Zheng, Jiayu
    Wang, Xinyao
    Zhang, Yue
    Bo, Liefeng
    Shi, Hailin
    Zhu, Rui
    Kumar, Aashish
    Li, Aijin
    Zinollayev, Almaz
    Askergaliyev, Anuar
    Schumann, Arne
    Mao, Binjie
    Lee, Byeongwon
    Liu, Chang
    Chen, Changrui
    Pan, Chunhong
    Huo, Chunlei
    Yu, Da
    Cong, Dechun
    Zeng, Dening
    Pailla, Dheeraj Reddy
    Li, Di
    Wang, Dong
    Cho, Donghyeon
    Zhang, Dongyu
    Bai, Furui
    Jose, George
    Gao, Guangyu
    Liu, Guizhong
    Xiong, Haitao
    Qi, Hao
    Wang, Haoran
    Qiu, Heqian
    Li, Hongliang
    Lu, Huchuan
    Kim, Ildoo
    Kim, Jaekyum
    Shen, Jane
    Lee, Jihoon
    Ge, Jing
    Xu, Jingjing
    Zhou, Jingkai
    Meier, Jonas
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW), 2019, : 213 - 226