RMT-YOLOv9s: An Infrared Small Target Detection Method Based on UAV Remote Sensing Images

被引:9
作者
Xu, Keyu [1 ]
Song, Chengtian [1 ,2 ]
Xie, Yue [2 ]
Pan, Lizhi [1 ]
Gan, Xiaozheng [1 ]
Huang, Gao [2 ,3 ]
机构
[1] Beijing Inst Technol, Sch Elect & Mech, Beijing 100081, Peoples R China
[2] Sci & Technol Electromech Dynam Control Lab, Xian 710065, Peoples R China
[3] Beijing Univ Technol, Sch Informat Sci & Technol, Beijing 100124, Peoples R China
关键词
Feature extraction; Object detection; Neck; Transformers; Accuracy; Head; Computer vision; Vehicle dynamics; Semantics; Remote sensing; Dysample; efficient multiscale attention (EMA); retentive networks meet vision transformer (RMT) transformer; unmanned aerial vehicle (UAV) infrared target detection; YOLOv9;
D O I
10.1109/LGRS.2024.3484748
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Unmanned aerial vehicles (UAVs) and infrared imaging technology have numerous applications in civilian fields. To address the issues of low accuracy resulting from complex ground backgrounds, small target size, and limited target features in UAV remote sensing infrared image target detection, we use the YOLOv9s model and the latest retentive networks meet vision transformers (RMTs) technology and propose the RMT-YOLOv9s model for infrared small target detection. First, a convolutional neural network (CNN)-RMT-based backbone is proposed by incorporating the RMT model into the backbone network of YOLOv9s, which extracts both local and global features for small target detection. Then, an improved neck multiscale feature-fusion network RMTELAN-PANet is designed using the novel convolutional RMTELAN module proposed in this letter, which can better capture and use semantic information from feature maps. Finally, efficient multiscale attention (EMA) attention module and upsampling Dysample module are integrated into RMTELAN-PANet to further improve the feature information of small targets. Experiments on the HIT-UAV dataset show that RMT-YOLOv9s outperforms other popular methods in infrared small target detection.
引用
收藏
页数:5
相关论文
共 23 条
[11]   Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks [J].
Ren, Shaoqing ;
He, Kaiming ;
Girshick, Ross ;
Sun, Jian .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (06) :1137-1149
[12]   Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localization [J].
Selvaraju, Ramprasaath R. ;
Cogswell, Michael ;
Das, Abhishek ;
Vedantam, Ramakrishna ;
Parikh, Devi ;
Batra, Dhruv .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :618-626
[13]   HIT-UAV: A high-altitude infrared thermal dataset for Unmanned Aerial Vehicle-based object detection [J].
Suo, Jiashun ;
Wang, Tianyi ;
Zhang, Xingzhou ;
Chen, Haiyang ;
Zhou, Wei ;
Shi, Weisong .
SCIENTIFIC DATA, 2023, 10 (01)
[14]  
Wang A, 2024, Arxiv, DOI arXiv:2405.14458
[15]   Multidirectional Ring Top-Hat Transformation for Infrared Small Target Detection [J].
Wang, Chenglong ;
Wang, Luping .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2021, 14 :8077-8088
[16]  
Wang CY, 2024, Arxiv, DOI [arXiv:2402.13616, 10.48550/arXiv.2402.13616, DOI 10.48550/ARXIV.2402.13616]
[17]   CSPNet: A New Backbone that can Enhance Learning Capability of CNN [J].
Wang, Chien-Yao ;
Liao, Hong-Yuan Mark ;
Wu, Yueh-Hua ;
Chen, Ping-Yang ;
Hsieh, Jun-Wei ;
Yeh, I-Hau .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2020), 2020, :1571-1580
[18]   PHSI-RTDETR: A Lightweight Infrared Small Target Detection Algorithm Based on UAV Aerial Photography [J].
Wang, Sen ;
Jiang, Huiping ;
Li, Zhongjie ;
Yang, Jixiang ;
Ma, Xuan ;
Chen, Jiamin ;
Tang, Xingqun .
DRONES, 2024, 8 (06)
[19]   Infrared Small-Target Detection Under a Complex Background Based on a Local Gradient Contrast Method [J].
Yang, Linna ;
Xie, Tao ;
Liu, Mingxing ;
Zhang, Mingjiang ;
Qi, Shuaihui ;
Yang, Jungang .
INTERNATIONAL JOURNAL OF APPLIED MATHEMATICS AND COMPUTER SCIENCE, 2023, 33 (01) :33-43
[20]   Infrared UAV Target Detection Based on Continuous-Coupled Neural Network [J].
Yang, Zhuoran ;
Lian, Jing ;
Liu, Jizhao .
MICROMACHINES, 2023, 14 (11)