A Graph Association Motion-Aware Tracker for Tiny Object in Satellite Videos

被引:0
作者
Huang, Zhongjian [1 ]
Jiao, Licheng [1 ]
Zhang, Jinyue [1 ]
Liu, Xu [1 ]
Liu, Fang [1 ]
Zhang, Xiangrong [1 ]
Li, Lingling [1 ]
Chen, Puhua [1 ]
机构
[1] Xidian Univ, Int Res Ctr Intelligent Percept & Computat, Sch Artificial Intelligence, Key Lab Intelligent Percept & Image Understanding, Xian 710071, Peoples R China
基金
中国国家自然科学基金;
关键词
Tracking; Target tracking; Satellites; Object tracking; Circuits and systems; Search problems; Proposals; Satellite video; object tracking; motion estimation; graph association; spatial relation; MOVING VEHICLE DETECTION; ASSIGNMENT; NETWORK;
D O I
10.1109/TCSVT.2024.3439371
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Satellite video object tracking involves tracking a specified tiny object within a wide scene. The insufficient appearance features of these tiny objects pose significant challenges to appearance-based object trackers, particularly in situations involving occlusion, target blur, and similar interferences. In this paper, a novel Graph Association MOtion-aware tracker (GAMO) is proposed for tiny object in satellite videos, which integrates motion and spatial relationship information. First, a Gaussian motion estimator is proposed that decouples motion into velocity and direction, rather than using traditional x-y movement modeling. This estimator predicts the object's position and estimates motion uncertainty with a directional motion probability map. Furthermore, the estimated motion serves as a prior to guide the proposal sampling. A probabilistic proposal sampling module is designed that samples candidate bounding boxes according to the directional motion probability map, focusing on the region where the target is most likely to appear. Additionally, we implement a graph association module to model and propagate the spatial relationships between the target and neighboring objects over time. This relationship information assists the appearance features in distinguishing the target from similar interferences. Experiments on the Skysat-1, SV248S, and VISO datasets demonstrate the superiority of the proposed tracker. GAMO leverages motion and surrounding information, resulting in significant improvements with minimal computational overhead. The code and results will be publicly available in https://github.com/Midkey/GAMO.
引用
收藏
页码:12907 / 12922
页数:16
相关论文
共 74 条
[1]   Moving vehicle detection, tracking and traffic parameter estimation from a satellite video: a perspective on a smarter city [J].
Ahmadi, Seyed Ali ;
Ghorbanian, Arsalan ;
Mohammadzadeh, Ali .
INTERNATIONAL JOURNAL OF REMOTE SENSING, 2019, 40 (22) :8379-8394
[2]  
Ahmadi SA, 2017, JOINT URB REMOTE SEN
[3]   Siamese-Based Twin Attention Network for Visual Tracking [J].
Bao, Hua ;
Shu, Ping ;
Zhang, Hongchao ;
Liu, Xiaobai .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (02) :847-860
[4]  
Bao J., 2023, IEEE Trans. Circuits Syst. Video Technol., DOI [10.1109/TCSVT.2023.3266485, DOI 10.1109/TCSVT.2023.3266485]
[5]   Fully-Convolutional Siamese Networks for Object Tracking [J].
Bertinetto, Luca ;
Valmadre, Jack ;
Henriques, Joao F. ;
Vedaldi, Andrea ;
Torr, Philip H. S. .
COMPUTER VISION - ECCV 2016 WORKSHOPS, PT II, 2016, 9914 :850-865
[6]  
Bhat Goutam, 2020, Computer Vision - ECCV 2020. 16th European Conference. Proceedings. Lecture Notes in Computer Science (LNCS 12368), P205, DOI 10.1007/978-3-030-58592-1_13
[7]  
Bolme DS, 2010, PROC CVPR IEEE, P2544, DOI 10.1109/CVPR.2010.5539960
[8]   Learning a Neural Solver for Multiple Object Tracking [J].
Braso, Guillem ;
Leal-Taixe, Laura .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, :6246-6256
[9]   Urban Traffic Monitoring and Analysis Using Unmanned Aerial Vehicles (UAVs): A Systematic Literature Review [J].
Butila, Eugen Valentin ;
Boboc, Razvan Gabriel .
REMOTE SENSING, 2022, 14 (03)
[10]   Robust Deformable and Occluded Object Tracking With Dynamic Graph [J].
Cai, Zhaowei ;
Wen, Longyin ;
Lei, Zhen ;
Vasconcelos, Nuno ;
Li, Stan Z. .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2014, 23 (12) :5497-5509