Remote sensing target tracking in satellite videos based on a variable-angle-adaptive Siamese network

被引:12
作者
Bi, Fukun [1 ]
Sun, Jiayi [1 ]
Han, Jianhong [1 ]
Wang, Yanping [1 ]
Bian, Mingming [2 ]
机构
[1] North China Univ Technol, Dept Sch Informat Sci & Technol, Beijing, Peoples R China
[2] Beijing Inst Spacecraft Syst Engn, Qian Xuesen Lab, Beijing, Peoples R China
关键词
This work was supported in part by the National Natural Science Foundation of China (Grant No. 61971006); Natural Science Foundation of Beijing Municipal (No. 4192021);
D O I
10.1049/ipr2.12170
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Remote sensing target tracking in satellite videos plays a key role in various fields. However, due to the complex backgrounds of satellite video sequences and many rotation changes of highly dynamic targets, typical target tracking methods for natural scenes cannot be used directly for such tasks, and their robustness and accuracy are difficult to guarantee. To address these problems, an algorithm is proposed for remote sensing target tracking in satellite videos based on a variable-angle-adaptive Siamese network (VAASN). Specifically, the method is based on the fully convolutional Siamese network (Siamese-FC). First, for the feature extraction stage, to reduce the impact of complex backgrounds, we present a new multifrequency feature representation method and introduce the octave convolution (OctConv) into the AlexNet architecture to adapt to the new feature representation. Then, for the tracking stage, to adapt to changes in target rotation, a variable-angle-adaptive module that uses a fast text detector with a single deep neural network (TextBoxes++) is introduced to extract angle information from the template frame and detection frames and performs angle consistency update operations on the detection frames. Finally, qualitative and quantitative experiments using satellite datasets show that the proposed method can improve tracking accuracy while achieving high efficiency.
引用
收藏
页码:1987 / 1997
页数:11
相关论文
共 26 条
[1]   Staple: Complementary Learners for Real-Time Tracking [J].
Bertinetto, Luca ;
Valmadre, Jack ;
Golodetz, Stuart ;
Miksik, Ondrej ;
Torr, Philip H. S. .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :1401-1409
[2]   Fully-Convolutional Siamese Networks for Object Tracking [J].
Bertinetto, Luca ;
Valmadre, Jack ;
Henriques, Joao F. ;
Vedaldi, Andrea ;
Torr, Philip H. S. .
COMPUTER VISION - ECCV 2016 WORKSHOPS, PT II, 2016, 9914 :850-865
[3]  
Bian, 2021, IET IMAGE PROCESS, P1
[4]   Self-supervised Learning with Geometric Constraints in Monocular Video Connecting Flow, Depth, and Camera [J].
Chen, Yuhua ;
Schmid, Cordelia ;
Sminchisescu, Cristian .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :7062-7071
[5]  
Danelljan M., 2014, BRIT MACH VIS C NOTT, DOI [10.5244/C.28.65, DOI 10.5244/C.28.65]
[6]   ECO: Efficient Convolution Operators for Tracking [J].
Danelljan, Martin ;
Bhat, Goutam ;
Khan, Fahad Shahbaz ;
Felsberg, Michael .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :6931-6939
[7]   Learning Spatially Regularized Correlation Filters for Visual Tracking [J].
Danelljan, Martin ;
Hager, Gustav ;
Khan, Fahad Shahbaz ;
Felsberg, Michael .
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, :4310-4318
[8]   Object Tracking in Satellite Videos by Fusing the Kernel Correlation Filter and the Three-Frame-Difference Algorithm [J].
Du, Bo ;
Sun, Yujia ;
Cai, Shihan ;
Wu, Chen ;
Du, Qian .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2018, 15 (02) :168-172
[9]   Object Tracking on Satellite Videos: A Correlation Filter-Based Tracking Method With Trajectory Correction by Kalman Filter [J].
Guo, Yujia ;
Yang, Daiqin ;
Chen, Zhenzhong .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2019, 12 (09) :3538-3551
[10]  
He A., 2018, EUR C COMP VIS