SOCF: A correlation filter for real-time UAV tracking based on spatial disturbance suppression and object saliency-aware

被引:16
作者
Ma, Sugang [1 ]
Zhao, Bo [1 ]
Hou, Zhiqiang [1 ]
Yu, Wangsheng [2 ]
Pu, Lei [3 ]
Yang, Xiaobao [4 ]
机构
[1] Xian Univ Posts & Telecommun, Sch Comp Sci & Technol, Xian 710121, Peoples R China
[2] Air Force Engn Univ, Sch Informat & Nav, Xian 710077, Peoples R China
[3] Rocket Force Univ Engn, Sch Operat Support, Xian 710025, Peoples R China
[4] Northwestern Polytech Univ, Sch Comp Sci & Engn, Xian 710072, Peoples R China
关键词
Object tracking; Correlation filter; Spatial disturbance suppression; Saliency-aware; REGULARIZED CORRELATION FILTER;
D O I
10.1016/j.eswa.2023.122131
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The discriminative correlation filter (DCF) is commonly used in aerial object tracking due to its high tracking accuracy and computing speed. However, when similar object disturbances emerge in the background, the response map will generate sub-peaks, which may eventually lead to tracking failure. Meanwhile, the lack of attention to the tracked object can also cause tracking performance degradation. To these concerns, this paper proposes a novel correlation filter algorithm for real-time aerial tracking based on spatial disturbance suppression and object saliency-aware, i.e., SOCF. Firstly, this paper designs a novel spatial disturbance suppression strategy. Using the temporal information in the historical response maps, we construct a context response map, deviating it from the current response map to detect disturbance information in the background. Then, construct a spatial interference map, divide it into n x n non-overlapping regions, and suppress the negative samples in the disturbance region within the main regression. Furthermore, an object saliency-aware strategy is proposed, using a saliency detection algorithm to calculate the object-aware mask and multiplying it with the detection filter to obtain the object-aware filter. By constructing the object-aware regularization in the training phase, the trained detection filter focuses more on the object itself and can effectively separate the object from the background. Extensive experiments on four widely used unmanned aerial vehicle (UAV) datasets demonstrate that the proposed SOCF tracker achieves high tracking performance. Meanwhile, our tracker can maintain real-time aerial tracking at 48 FPS on a single CPU.
引用
收藏
页数:12
相关论文
共 50 条
  • [1] Learning Spatial Regularization Correlation Filters With the Hilbert-Schmidt Independence Criterion in RKHS for UAV Tracking
    An, Zhiyong
    Wang, Xiumin
    Li, Bo
    Fu, Jingyi
    [J]. IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72
  • [2] Staple: Complementary Learners for Real-Time Tracking
    Bertinetto, Luca
    Valmadre, Jack
    Golodetz, Stuart
    Miksik, Ondrej
    Torr, Philip H. S.
    [J]. 2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 1401 - 1409
  • [3] Bolme DS, 2010, PROC CVPR IEEE, P2544, DOI 10.1109/CVPR.2010.5539960
  • [4] Distributed optimization and statistical learning via the alternating direction method of multipliers
    Boyd S.
    Parikh N.
    Chu E.
    Peleato B.
    Eckstein J.
    [J]. Foundations and Trends in Machine Learning, 2010, 3 (01): : 1 - 122
  • [5] Visual Tracking via Adaptive Spatially-Regularized Correlation Filters
    Dai, Kenan
    Wang, Dong
    Lu, Huchuan
    Sun, Chong
    Li, Jianhua
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 4665 - 4674
  • [6] Histograms of oriented gradients for human detection
    Dalal, N
    Triggs, B
    [J]. 2005 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOL 1, PROCEEDINGS, 2005, : 886 - 893
  • [7] Danelljan M., 2014, P BRIT MACH VIS C, P1
  • [8] ECO: Efficient Convolution Operators for Tracking
    Danelljan, Martin
    Bhat, Goutam
    Khan, Fahad Shahbaz
    Felsberg, Michael
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 6931 - 6939
  • [9] Beyond Correlation Filters: Learning Continuous Convolution Operators for Visual Tracking
    Danelljan, Martin
    Robinson, Andreas
    Khan, Fahad Shahbaz
    Felsberg, Michael
    [J]. COMPUTER VISION - ECCV 2016, PT V, 2016, 9909 : 472 - 488
  • [10] Learning Spatially Regularized Correlation Filters for Visual Tracking
    Danelljan, Martin
    Hager, Gustav
    Khan, Fahad Shahbaz
    Felsberg, Michael
    [J]. 2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, : 4310 - 4318