AIMED-Net: An Enhancing Infrared Small Target Detection Net in UAVs with Multi-Layer Feature Enhancement for Edge Computing

被引:8
作者
Pan, Lehao [1 ]
Liu, Tong [1 ]
Cheng, Jianghua [1 ]
Cheng, Bang [1 ]
Cai, Yahui [1 ]
机构
[1] Natl Univ Def Technol, Coll Elect Sci & Technol, Changsha 410073, Peoples R China
关键词
edge computing; deep learning; infrared image enhancement; infrared small target detection; IMAGE-ENHANCEMENT;
D O I
10.3390/rs16101776
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
In the context of small unmanned aerial vehicles (UAVs), infrared imaging faces challenges such as low quality, difficulty in detecting small targets, high false alarm rates, and computational resource constraints. To address these issues, we introduce AIMED-Net, an enhancing infrared small target detection net in UAVs with multi-layer feature enhancement for edge computing. Initially, the network encompasses a multi-layer feature enhancement architecture for infrared small targets, including a generative adversarial-based shallow-feature enhancement network and a detection-oriented deep-feature enhancement network. Specifically, an infrared image-feature enhancement method is proposed for the shallow-feature enhancement network, employing multi-scale enhancement to bolster target detection performance. Furthermore, within the YOLOv7 framework, we have developed an improved object detection network integrating multiple feature enhancement techniques, optimized for infrared targets and edge computing conditions. This design not only reduces the model's complexity but also enhances the network's robustness and accuracy in identifying small targets. Experimental results obtained from the HIT-UAV public dataset indicate that, compared to YOLOv7s, our method achieves a 2.5% increase in F1 score, a 6.1% rise in AP for detecting OtherVehicle targets, and a 2.6% improvement in mAP across all categories, alongside a 15.2% reduction in inference time on edge devices. Compared to existing state-of-the-art approaches, our method strikes a balance between detection efficiency and accuracy, presenting a practical solution for deployment in aerial edge computing scenarios.
引用
收藏
页数:24
相关论文
共 36 条
[1]   Image up-sampling using total-variation regularization with a new observation model [J].
Aly, HA ;
Dubois, E .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2005, 14 (10) :1647-1659
[2]  
Bochkovskiy A, 2020, Arxiv, DOI [arXiv:2004.10934, 10.48550/arXiv.2004.10934, DOI 10.48550/ARXIV.2004.10934]
[3]   Perceptual Underwater Image Enhancement With Deep Learning and Physical Priors [J].
Chen, Long ;
Jiang, Zheheng ;
Tong, Lei ;
Liu, Zhihua ;
Zhao, Aite ;
Zhang, Qianni ;
Dong, Junyu ;
Zhou, Huiyu .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2021, 31 (08) :3078-3092
[4]   Attentional Local Contrast Networks for Infrared Small Target Detection [J].
Dai, Yimian ;
Wu, Yiquan ;
Zhou, Fei ;
Barnard, Kobus .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2021, 59 (11) :9813-9824
[5]   Asymmetric Contextual Modulation for Infrared Small Target Detection [J].
Dai, Yimian ;
Wu, Yiquan ;
Zhou, Fei ;
Barnard, Kobus .
2021 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2021), 2021, :949-958
[6]   Fast R-CNN [J].
Girshick, Ross .
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, :1440-1448
[7]   Rich feature hierarchies for accurate object detection and semantic segmentation [J].
Girshick, Ross ;
Donahue, Jeff ;
Darrell, Trevor ;
Malik, Jitendra .
2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, :580-587
[8]   Dynamic Low-Light Image Enhancement for Object Detection via End-to-End Training [J].
Guo, Haifeng ;
Lu, Tong ;
Wu, Yirui .
2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, :5611-5618
[9]   ISTDU-Net: Infrared Small-Target Detection U-Net [J].
Hou, Qingyu ;
Zhang, Liuwei ;
Tan, Fanjiao ;
Xi, Yuyang ;
Zheng, Haoliang ;
Li, Na .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
[10]   DSNet: Joint Semantic Learning for Object Detection in Inclement Weather Conditions [J].
Huang, Shih-Chia ;
Le, Trung-Hieu ;
Jaw, Da-Wei .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2021, 43 (08) :2623-2633