Aligned Spatial-Temporal Memory Network for Thermal Infrared Target Tracking

被引:71
作者
Yuan, Di [1 ]
Shu, Xiu [2 ]
Liu, Qiao [3 ]
He, Zhenyu [4 ]
机构
[1] Xidian Univ, Guangzhou Inst Technol, Guangzhou 510555, Peoples R China
[2] Harbin Inst Technol, Sch Sci, Shenzhen 518055, Peoples R China
[3] Chongqing Normal Univ, Natl Ctr Appl Math, Chongqing 401331, Peoples R China
[4] Harbin Inst Technol, Sch Comp Sci & Technol, Shenzhen 518055, Peoples R China
基金
中国博士后科学基金; 中国国家自然科学基金;
关键词
Target tracking; Task analysis; Training; Interference; Benchmark testing; Feature extraction; Convolution; Thermal infrared tracking; spatial-temporal memory network; aligned matching module; OBJECT TRACKING;
D O I
10.1109/TCSII.2022.3223871
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Thermal infrared (TIR) target tracking is susceptible to occlusion and similarity interference, which obviously affects the tracking results. To resolve this problem, we develop an Aligned Spatial-Temporal Memory network-based Tracking method (ASTMT) for the TIR target tracking task. Specifically, we model the scene information in the TIR target tracking scenario using the spatial-temporal memory network, which can effectively store the scene information and decrease the interference of similarity interference that is beneficial to the target. In addition, we use an aligned matching module to correct the parameters of the spatial-temporal memory network model, which can effectively alleviate the impact of occlusion on the target estimation, hence boosting the tracking accuracy even further. Through ablation study experiments, we have demonstrated that the spatial-temporal memory network and the aligned matching module in the proposed ASTMT tracker are exceptionally successful. Our ASTMT tracking method performs well on the PTB-TIR and LSOTB-TIR benchmarks contrasted with other tracking methods.
引用
收藏
页码:1224 / 1228
页数:5
相关论文
共 45 条
[11]   Infrared Target Tracking Using Multi-Feature Joint Sparse Representation [J].
Gao, Shu Juan ;
Jhang, Seong Tae .
2016 RESEARCH IN ADAPTIVE AND CONVERGENT SYSTEMS, 2016, :40-45
[12]   Graph Attention Tracking [J].
Guo, Dongyan ;
Shao, Yanyan ;
Cui, Ying ;
Wang, Zhenhua ;
Zhang, Liyan ;
Shen, Chunhua .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :9538-9547
[13]   Learning to Fuse Asymmetric Feature Maps in Siamese Trackers [J].
Han, Wencheng ;
Dong, Xingping ;
Khan, Fahad Shahbaz ;
Shao, Ling ;
Shen, Jianbing .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :16565-16575
[14]   A Low-Cost High-Speed Object Tracking VLSI System Based on Unified Textural and Dynamic Compressive Features [J].
He, Wei ;
Zhang, Jie ;
Lin, Yingcheng ;
Zhou, Xichuan ;
Li, Ping ;
Liu, Liyuan ;
Wu, Nanjian ;
Shi, Cong .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS, 2021, 68 (03) :1013-1017
[15]   A 64.1mW Accurate Real-Time Visual Object Tracking Processor With Spatial Early Stopping on Siamese Network [J].
Kim, Soyeon ;
Kim, Sangjin ;
Kim, Sangyeob ;
Han, Donghyeon ;
Yoo, Hoi-Jun .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS, 2021, 68 (05) :1675-1679
[16]   SiamRPN plus plus : Evolution of Siamese Visual Tracking with Very Deep Networks [J].
Li, Bo ;
Wu, Wei ;
Wang, Qiang ;
Zhang, Fangyi ;
Xing, Junliang ;
Yan, Junjie .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :4277-4286
[17]  
Li L., 2019, REMOTE SENS-BASEL, V11
[18]   Target-Aware Deep Tracking [J].
Li, Xin ;
Ma, Chao ;
Wu, Baoyuan ;
He, Zhenyu ;
Yang, Ming-Hsuan .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :1369-1378
[19]   Hierarchical spatial-aware Siamese network for thermal infrared object tracking [J].
Li, Xin ;
Liu, Qiao ;
Fan, Nana ;
He, Zhenyu ;
Wang, Hongzhi .
KNOWLEDGE-BASED SYSTEMS, 2019, 166 :71-81
[20]   Learning Deep Multi-Level Similarity for Thermal Infrared Object Tracking [J].
Liu, Qiao ;
Li, Xin ;
He, Zhenyu ;
Fan, Nana ;
Yuan, Di ;
Wang, Hongpeng .
IEEE TRANSACTIONS ON MULTIMEDIA, 2021, 23 :2114-2126