ABMNET: COUPLING TRANSFORMER WITH CNN BASED ON ADAMS-BASHFORTH-MOULTON METHOD FOR INFRARED SMALL TARGET DETECTION

被引:7
作者
Chen, Tianxiang [1 ,3 ]
Chu, Qi [1 ,3 ]
Tan, Zhentao [1 ,2 ,3 ]
Liu, Bin [1 ,3 ]
Yu, Nenghai [1 ,3 ]
机构
[1] Univ Sci & Technol China, Sch Cyber Sci & Technol, Beijing, Peoples R China
[2] Alibaba DAMO Acad, Beijing, Peoples R China
[3] Chinese Acad Sci, Key Lab Elect Space Informat, Beijing, Peoples R China
来源
2023 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, ICME | 2023年
基金
中国国家自然科学基金;
关键词
Infrared small target detection; Adams-Bashforth-Moulton method; Vision transformer;
D O I
10.1109/ICME55011.2023.00326
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Infrared small target detection (ISTD) aims at segmenting the small targets from infrared images, which has wide applications in military surveillance. Present methods are mainly based on CNN and focus on modelling locality while ignoring global dependencies, which are indispensable because the local areas similar to small targets always spread over most of the background, causing heavy target ambiguity. Recently, RKformer [1] has combined local features with global dependencies and further introduced Runge-Kutta method, a one-step Ordinary Differential Equation (ODE) solver, to ISTD and performed well. However, the method simply fuses features from original transformer and residual blocks by naive concatenation, causing insufficient feature interaction. Also, it inevitably brings effective information loss, which greatly impairs ambiguous target features. To address above problems and target ambiguity, we introduce Adams-Bashforth-Moulton method and propose ABMNet, which has (1) multistep memory and self-rectification mechanisms, guaranteeing more sufficient information usage and more accurate detection, (2) and achieves more sufficient interaction of both local and global information. Experiments on MDFA and IRSTD-1k demonstrate the superiority of our method.
引用
收藏
页码:1901 / 1906
页数:6
相关论文
共 20 条
[11]  
Lu YP, 2019, Arxiv, DOI [arXiv:1906.02762, DOI 10.48550/ARXIV.1906.02762, 10.48550/arxiv.1906.02762]
[12]   Flying small target detection in IR images based on adaptive toggle operator [J].
Marvasti, Fereshteh Seyed ;
Mosavi, Mohammad Reza ;
Nasiri, Mahdi .
IET COMPUTER VISION, 2018, 12 (04) :527-534
[13]   FTC-Net: Fusion of Transformer and CNN Features for Infrared Small Target Detection [J].
Qi, Meibin ;
Liu, Liu ;
Zhuang, Shuo ;
Liu, Yimin ;
Li, Kunyuan ;
Yang, Yanfang ;
Li, Xiaohong .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2022, 15 :8613-8623
[14]   Detection of dim targets in digital infrared imagery by morphological image processing [J].
Rivest, JF ;
Fortin, R .
OPTICAL ENGINEERING, 1996, 35 (07) :1886-1893
[15]   Miss Detection vs. False Alarm: Adversarial Learning for Small Object Segmentation in Infrared Images [J].
Wang, Huan ;
Zhou, Luping ;
Wang, Lei .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :8508-8517
[16]   Interior Attention-Aware Network for Infrared Small Target Detection [J].
Wang, Kewei ;
Du, Shuaiyuan ;
Liu, Chengxin ;
Cao, Zhiguo .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
[17]   A Proposal on Machine Learning via Dynamical Systems [J].
Weinan, E. .
COMMUNICATIONS IN MATHEMATICS AND STATISTICS, 2017, 5 (01) :1-11
[18]   Infrared Small Target Detection via Non-Convex Rank Approximation Minimization Joint l2,1 Norm [J].
Zhang, Landan ;
Peng, Lingbing ;
Zhang, Tianfang ;
Cao, Siying ;
Peng, Zhenming .
REMOTE SENSING, 2018, 10 (11)
[19]   RKformer: Runge-Kutta Transformer with Random-Connection Attention for Infrared Small Target Detection [J].
Zhang, Mingjin ;
Bai, Haichen ;
Zhang, Jing ;
Zhang, Rui ;
Wang, Chaoyue ;
Guo, Jie ;
Gao, Xinbo .
PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, :1730-1738
[20]  
Zhang TF, 2021, Arxiv, DOI [arXiv:2111.03580, 10.48550/arXiv.2111.03580, DOI 10.48550/ARXIV.2111.03580]