Hypothesis Testing Based Tracking With Spatio-Temporal Joint Interaction Modeling

被引:30
作者
Sheng, Hao [1 ,2 ]
Zhang, Yang [1 ,2 ]
Wu, Yubin [1 ,3 ]
Wang, Shuai [1 ,3 ]
Lyu, Weifeng [1 ,2 ]
Ke, Wei [4 ]
Xiong, Zhang [1 ,3 ]
机构
[1] Beihang Univ, Sch Comp Sci & Engn, State Key Lab Software Dev Environm, Beijing 100191, Peoples R China
[2] Beihang Univ, Beijing Adv Innovat Ctr Big Data & Brain Comp, Beijing 100191, Peoples R China
[3] Beihang Univ, Beihang Hangzhou Inst Innovat Yuhang, Hangzhou 311121, Peoples R China
[4] Macao Polytech Inst, Sch Appl Sci, Macau 999078, Peoples R China
基金
中国国家自然科学基金;
关键词
Target tracking; Trajectory; Testing; Robustness; Feature extraction; Electronic mail; Multi-object tracking; tracking-by-detection; network flow; hypothesis testing; interaction modeling; MULTITARGET;
D O I
10.1109/TCSVT.2020.2988649
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Data association is one of the key research in tracking-by-detection framework. Due to frequent interactions among targets, there are various relationships among trajectories in crowded scenes which leads to problems in data association, such as association ambiguity, association omission, etc. To handle these problems, we propose hypothesis-testing based tracking (HTBT) framework to build potential associations between target by constructing and testing hypotheses. In addition, a spatio-temporal interaction graph (STIG) model is introduced to describe the basic interaction patterns of trajectories and test the potential hypotheses. Based on network flow optimization, we formulate offline tracking as a MAP problem. Experimental results show that our tracking framework improves the robustness of tracklet association when detection failure occurs during tracking. On the public MOT16, MOT17 and MOT20 benchmark, our method achieves competitive results compared with other state-of-the-art methods.
引用
收藏
页码:2971 / 2983
页数:13
相关论文
共 44 条
  • [31] Shen Han, 2018, ARXIV180801562
  • [32] Mining Hard Samples Globally and Efficiently for Person Reidentification
    Sheng, Hao
    Zheng, Yanwei
    Ke, Wei
    Yu, Dongxiao
    Cheng, Xiuzhen
    Lyu, Weifeng
    Xiong, Zhang
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2020, 7 (10) : 9611 - 9622
  • [33] Iterative Multiple Hypothesis Tracking With Tracklet-Level Association
    Sheng, Hao
    Chen, Jiahui
    Zhang, Yang
    Ke, Wei
    Xiong, Zhang
    Yu, Jingyi
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2019, 29 (12) : 3660 - 3672
  • [34] Heterogeneous Association Graph Fusion for Target Association in Multiple Object Tracking
    Sheng, Hao
    Zhang, Yang
    Chen, Jiahui
    Xiong, Zhang
    Zhang, Jun
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2019, 29 (11) : 3269 - 3280
  • [35] Video object tracking using adaptive Kalman filter
    Shiuh-Ku Weng
    Chung-Ming Kuo
    Shu-Kang Tu
    [J]. JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2006, 17 (06) : 1190 - 1208
  • [36] Self-paced learning for long-term tracking
    Supancic, James Steven, III
    Ramanan, Deva
    [J]. 2013 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2013, : 2379 - 2386
  • [37] Multiple People Tracking by Lifted Multicut and Person Re-identification
    Tang, Siyu
    Andriluka, Mykhaylo
    Andres, Bjoern
    Schiele, Bernt
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 3701 - 3710
  • [38] Learning Spatio-Temporal Information for Multi-Object Tracking
    Wei, Jian
    Yang, Mei
    Liu, Feng
    [J]. IEEE ACCESS, 2017, 5 : 3869 - 3877
  • [39] Yoon Y.-C, 2019, ARXIV190700831
  • [40] Yoon YC, 2018, 2018 15TH IEEE INTERNATIONAL CONFERENCE ON ADVANCED VIDEO AND SIGNAL BASED SURVEILLANCE (AVSS), P91