Single Object Tracking in Satellite Videos Based on Feature Enhancement and Multi-Level Matching Strategy

被引:7
作者
Yang, Jianwei [1 ,2 ,3 ]
Pan, Zongxu [1 ,2 ,3 ]
Liu, Yuhan [1 ,2 ]
Niu, Ben [1 ,2 ,3 ]
Lei, Bin [1 ,2 ,3 ]
机构
[1] Chinese Acad Sci, Aerosp Informat Res Inst, Beijing 100094, Peoples R China
[2] Chinese Acad Sci, Key Lab Technol Geospatial Informat Proc & Applica, Beijing 100190, Peoples R China
[3] Univ Chinese Acad Sci, Sch Elect Elect & Commun Engn, Beijing 100049, Peoples R China
关键词
satellite video; object tracking; siamese network; feature enhancement; matching strategy; SIAMESE NETWORKS;
D O I
10.3390/rs15174351
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Despite significant advancements in remote sensing object tracking (RSOT) in recent years, achieving accurate and continuous tracking of tiny-sized targets remains a challenging task due to similar object interference and other related issues. In this paper, from the perspective of feature enhancement and a better feature matching strategy, we present a tracker SiamTM specifically designed for RSOT, which is mainly based on a new target information enhancement (TIE) module and a multi-level matching strategy. First, we propose a TIE module to address the challenge of tiny object sizes in satellite videos. The proposed TIE module goes along two spatial directions to capture orientation and position-aware information, respectively, while capturing inter-channel information at the global 2D image level. The TIE module enables the network to extract discriminative features of the targets more effectively from satellite images. Furthermore, we introduce a multi-level matching (MM) module that is better suited for satellite video targets. The MM module firstly embeds the target feature map after ROI Align into each position of the search region feature map to obtain a preliminary response map. Subsequently, the preliminary response map and the template region feature map are subjected to the Depth-wise Cross Correlation operation to get a more refined response map. Through this coarse-to-fine approach, the tracker obtains a response map with a more accurate position, which lays a good foundation for the prediction operation of the subsequent sub-networks. We conducted extensive experiments on two large satellite video single-object tracking datasets: SatSOT and SV248S. Without bells and whistles, the proposed tracker SiamTM achieved competitive results on both datasets while running at real-time speed.
引用
收藏
页数:25
相关论文
共 63 条
  • [1] Fully-Convolutional Siamese Networks for Object Tracking
    Bertinetto, Luca
    Valmadre, Jack
    Henriques, Joao F.
    Vedaldi, Andrea
    Torr, Philip H. S.
    [J]. COMPUTER VISION - ECCV 2016 WORKSHOPS, PT II, 2016, 9914 : 850 - 865
  • [2] Learning Discriminative Model Prediction for Tracking
    Bhat, Goutam
    Danelljan, Martin
    Van Gool, Luc
    Timofte, Radu
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 6181 - 6190
  • [3] Bingyan Liao, 2020, Computer Vision - ECCV 2020 16th European Conference. Proceedings. Lecture Notes in Computer Science (LNCS 12367), P429, DOI 10.1007/978-3-030-58542-6_26
  • [4] Robust Object Tracking Algorithm for Autonomous Vehicles in Complex Scenes
    Cao, Jingwei
    Song, Chuanxue
    Song, Shixin
    Xiao, Feng
    Zhang, Xu
    Liu, Zhiyang
    Ang, Marcelo H., Jr.
    [J]. REMOTE SENSING, 2021, 13 (16)
  • [5] SiamAPN plus plus : Siamese Attentional Aggregation Network for Real-Time UAV Tracking
    Cao, Ziang
    Fu, Changhong
    Ye, Junjie
    Li, Bowen
    Li, Yiming
    [J]. 2021 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2021, : 3086 - 3092
  • [6] Siamese Implicit Region Proposal Network With Compound Attention for Visual Tracking
    Chan, Sixian
    Tao, Jian
    Zhou, Xiaolong
    Bai, Cong
    Zhang, Xiaoqin
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 1882 - 1894
  • [7] Vehicle Tracking on Satellite Video Based on Historical Model
    Chen, Shili
    Wang, Taoyang
    Wang, Hongshuo
    Wang, Yunming
    Hong, Jianzhi
    Dong, Tiancheng
    Li, Zhen
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2022, 15 : 7784 - 7796
  • [8] Transformer Tracking
    Chen, Xin
    Yan, Bin
    Zhu, Jiawen
    Wang, Dong
    Yang, Xiaoyun
    Lu, Huchuan
    [J]. 2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 8122 - 8131
  • [9] Siamese Box Adaptive Network for Visual Tracking
    Chen, Zedu
    Zhong, Bineng
    Li, Guorong
    Zhang, Shengping
    Ji, Rongrong
    [J]. 2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 6667 - 6676
  • [10] MixFormer: End-to-End Tracking with Iterative Mixed Attention
    Cui, Yutao
    Jiang, Cheng
    Wang, Limin
    Wu, Gangshan
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 13598 - 13608