Enhancing visual monitoring via multi-feature fusion and template update strategies

被引:0
作者
Rafique, Fahad [1 ]
Zheng, Liying [1 ]
Benarab, Acheraf [1 ]
Javed, Muhammad Hafeez [2 ]
机构
[1] Harbin Engn Univ, Coll Comp Sci & Technol, Harbin 150001, Peoples R China
[2] Southwest Jiaotong Univ, Sch Comp & Artificial Intelligence, Chengdu 611756, Peoples R China
基金
中国国家自然科学基金;
关键词
Object tracking; Feature fusion; Discriminative correlation filter; Response deviation; CORRELATION FILTER; OBJECT TRACKING; NETWORKS;
D O I
10.1007/s11760-024-03526-1
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Recent advancements in computer vision, particularly deep learning, have significantly influenced visual monitoring across varied scenes. However, traditional machine learning approaches, particularly those based on correlation filtering (CF), remain valuable due to their efficiency in data collection, lower computational needs and improved explain ability. While CF-based tracking methods have become popular for analyzing complex scenes, they often rely on single features, limiting their ability to capture dynamic target appearances and resulting in inaccurate target tracking. Traditional template update techniques might also result in low accuracy and inaccurate feature extraction. In contrast, we introduces a location fusion mechanism incorporating multiple feature information streams to improve real-time monitoring in complex scenes. These strategies periodically extract four types of features and fuse their response maps, ensuring robust target tracking with high accuracy. Further innovations, such as dynamic spatial regularization and a multi-memory tracking framework, enable filters to focus on more reliable regions and suppress response deviations across consecutive frames. On the basis of confidence score a novel template update, storage and retrieval mechanism is implemented. Extensive testing across datasets like OTB100, VOT2016 and VOT2018 confirms that these integrated approaches outperform 26 state-of-the-art algorithms by balancing tracking success and computational efficiency in complex scenes.
引用
收藏
页码:9009 / 9026
页数:18
相关论文
共 56 条
  • [1] CIE XYZ Net: Unprocessing Images for Low-Level Computer Vision Tasks
    Afifi, Mahmoud
    Abdelhamed, Abdelrahman
    Abuolaim, Abdullah
    Punnappurath, Abhijith
    Brown, Michael S.
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (09) : 4688 - 4700
  • [2] Staple: Complementary Learners for Real-Time Tracking
    Bertinetto, Luca
    Valmadre, Jack
    Golodetz, Stuart
    Miksik, Ondrej
    Torr, Philip H. S.
    [J]. 2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 1401 - 1409
  • [3] Fully-Convolutional Siamese Networks for Object Tracking
    Bertinetto, Luca
    Valmadre, Jack
    Henriques, Joao F.
    Vedaldi, Andrea
    Torr, Philip H. S.
    [J]. COMPUTER VISION - ECCV 2016 WORKSHOPS, PT II, 2016, 9914 : 850 - 865
  • [4] Bolme DS, 2010, PROC CVPR IEEE, P2544, DOI 10.1109/CVPR.2010.5539960
  • [5] Backbone is All Your Need: A Simplified Architecture for Visual Object Tracking
    Chen, Boyu
    Li, Peixia
    Bai, Lei
    Qiao, Lei
    Shen, Qiuhong
    Li, Bo
    Gan, Weihao
    Wu, Wei
    Ouyang, Wanli
    [J]. COMPUTER VISION, ECCV 2022, PT XXII, 2022, 13682 : 375 - 392
  • [6] SeqTrack: Sequence to Sequence Learning for Visual Object Tracking
    Chen, Xin
    Peng, Houwen
    Wang, Dong
    Lu, Huchuan
    Hu, Han
    [J]. 2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 14572 - 14581
  • [7] Satellite video single object tracking: A systematic review and an oriented object tracking benchmark
    Chen, Yuzeng
    Tang, Yuqi
    Xiao, Yi
    Yuan, Qiangqiang
    Zhang, Yuwei
    Liu, Fengqing
    He, Jiang
    Zhang, Liangpei
    [J]. ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2024, 210 : 212 - 240
  • [8] SPIRIT: Spectral Awareness Interaction Network With Dynamic Template for Hyperspectral Object Tracking
    Chen, Yuzeng
    Yuan, Qiangqiang
    Tang, Yuqi
    Xiao, Yi
    He, Jiang
    Zhang, Liangpei
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 16
  • [9] Danelljan M., 2014, BRIT MACH VIS C, DOI [10.5244/C.28.65, DOI 10.5244/C.28.65]
  • [10] ECO: Efficient Convolution Operators for Tracking
    Danelljan, Martin
    Bhat, Goutam
    Khan, Fahad Shahbaz
    Felsberg, Michael
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 6931 - 6939