Adaptive Frame Sampling and Feature Alignment for Multi-Frame Infrared Small Target Detection

被引:1
作者
Yao, Chuanhong [1 ]
Zhao, Haitao [1 ]
机构
[1] East China Univ Sci & Technol, Sch Informat Sci & Engn, Automat Dept, Shanghai 200237, Peoples R China
来源
APPLIED SCIENCES-BASEL | 2024年 / 14卷 / 14期
基金
中国国家自然科学基金;
关键词
infrared small target detection; multi-frame; adaptive frame sampling; feature alignment;
D O I
10.3390/app14146360
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
In recent years, infrared images have attracted widespread attention, due to their extensive application in low-visibility search and rescue, forest fire monitoring, ground target monitoring, and other fields. Infrared small target detection technology plays a vital role in these applications. Although there has been significant research over the years, accurately detecting infrared small targets in complex backgrounds remains a significant challenge. Multi-frame detection methods can significantly improve detection performance in these cases. However, current multi-frame methods face difficulties in balancing the number of input frames and detection speed, and cannot effectively handle the background motion caused by movement of the infrared camera. To address these issues, we propose an adaptive frame sampling method and a detection network aligned at the feature level. Our adaptive frame sampling method uses mutual information to measure motion changes between adjacent frames, construct a motion distribution, and sample frames with uniform motion based on the averaged motion distribution. Our detection network handles background motion by predicting a homography flow matrix that aligns features at the feature level. Extensive evaluation of all components showed that the proposed method can more effectively perform multi-frame infrared small target detection.
引用
收藏
页数:18
相关论文
共 48 条
[1]   Target Detection Algorithm Based on Two Layers Human Visual System [J].
Cui, Zheng ;
Yang, Jingli ;
Jiang, Shouda ;
Wei, Changan .
ALGORITHMS, 2015, 8 (03) :541-551
[2]   Infrared small target and background separation via column-wise weighted robust principal component analysis [J].
Dai, Yimian ;
Wu, Yiquan ;
Song, Yu .
INFRARED PHYSICS & TECHNOLOGY, 2016, 77 :421-430
[3]   Infrared Small-Target Detection Using Multiscale Gray Difference Weighted Image Entropy [J].
Deng, He ;
Sun, Xianping ;
Liu, Maili ;
Ye, Chaohui ;
Zhou, Xin .
IEEE TRANSACTIONS ON AEROSPACE AND ELECTRONIC SYSTEMS, 2016, 52 (01) :60-72
[4]  
Du J., 2021, P 2021 4 INT C ALG C, P1
[5]   A Spatial-Temporal Feature-Based Detection Framework for Infrared Dim Small Target [J].
Du, Jinming ;
Lu, Huanzhang ;
Zhang, Luping ;
Hu, Moufa ;
Chen, Sheng ;
Deng, Yingjie ;
Shen, Xinglin ;
Zhang, Yu .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
[6]  
Howard AG, 2017, Arxiv, DOI [arXiv:1704.04861, 10.48550/arXiv.1704.04861]
[7]   Infrared Patch-Image Model for Small Target Detection in a Single Image [J].
Gao, Chenqiang ;
Meng, Deyu ;
Yang, Yi ;
Wang, Yongtao ;
Zhou, Xiaofang ;
Hauptmann, Alexander G. .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2013, 22 (12) :4996-5009
[8]   Detecting slowly moving infrared targets using temporal filtering and association strategy [J].
Gao, Jing-li ;
Wen, Cheng-lin ;
Bao, Zhe-jing ;
Liu, Mei-qin .
FRONTIERS OF INFORMATION TECHNOLOGY & ELECTRONIC ENGINEERING, 2016, 17 (11) :1176-1185
[9]   A Kernel-Based Nonparametric Regression Method for Clutter Removal in Infrared Small-Target Detection Applications [J].
Gu, Yanfeng ;
Wang, Chen ;
Liu, BaoXue ;
Zhang, Ye .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2010, 7 (03) :469-473
[10]  
Guo J., 2008, SPIE, V6835, P178