Hypothesis Testing Based Tracking With Spatio-Temporal Joint Interaction Modeling

被引:30
作者
Sheng, Hao [1 ,2 ]
Zhang, Yang [1 ,2 ]
Wu, Yubin [1 ,3 ]
Wang, Shuai [1 ,3 ]
Lyu, Weifeng [1 ,2 ]
Ke, Wei [4 ]
Xiong, Zhang [1 ,3 ]
机构
[1] Beihang Univ, Sch Comp Sci & Engn, State Key Lab Software Dev Environm, Beijing 100191, Peoples R China
[2] Beihang Univ, Beijing Adv Innovat Ctr Big Data & Brain Comp, Beijing 100191, Peoples R China
[3] Beihang Univ, Beihang Hangzhou Inst Innovat Yuhang, Hangzhou 311121, Peoples R China
[4] Macao Polytech Inst, Sch Appl Sci, Macau 999078, Peoples R China
基金
中国国家自然科学基金;
关键词
Target tracking; Trajectory; Testing; Robustness; Feature extraction; Electronic mail; Multi-object tracking; tracking-by-detection; network flow; hypothesis testing; interaction modeling; MULTITARGET;
D O I
10.1109/TCSVT.2020.2988649
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Data association is one of the key research in tracking-by-detection framework. Due to frequent interactions among targets, there are various relationships among trajectories in crowded scenes which leads to problems in data association, such as association ambiguity, association omission, etc. To handle these problems, we propose hypothesis-testing based tracking (HTBT) framework to build potential associations between target by constructing and testing hypotheses. In addition, a spatio-temporal interaction graph (STIG) model is introduced to describe the basic interaction patterns of trajectories and test the potential hypotheses. Based on network flow optimization, we formulate offline tracking as a MAP problem. Experimental results show that our tracking framework improves the robustness of tracklet association when detection failure occurs during tracking. On the public MOT16, MOT17 and MOT20 benchmark, our method achieves competitive results compared with other state-of-the-art methods.
引用
收藏
页码:2971 / 2983
页数:13
相关论文
共 44 条
  • [1] [Anonymous], 2018, LECTURE NOTES COMPUT
  • [2] Tracking without bells and whistles
    Bergmann, Philipp
    Meinhardt, Tim
    Leal-Taixe, Laura
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 941 - 951
  • [3] Evaluating Multiple Object Tracking Performance: The CLEAR MOT Metrics
    Bernardin, Keni
    Stiefelhagen, Rainer
    [J]. EURASIP JOURNAL ON IMAGE AND VIDEO PROCESSING, 2008, 2008 (1)
  • [4] Bochinski Erik, 2017, 2017 14th IEEE International Conference on Advanced Video and Signal-Based Surveillance (AVSS), DOI 10.1109/AVSS.2017.8078516
  • [5] Multi-target Tracking by Lagrangian Relaxation to Min-Cost Network Flow
    Butt, Asad A.
    Collins, Robert T.
    [J]. 2013 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2013, : 1846 - 1853
  • [6] Chari V, 2015, PROC CVPR IEEE, P5537, DOI 10.1109/CVPR.2015.7299193
  • [7] Community Evolution Model for Network Flow Based Multiple Object Tracking
    Chen, Jiahui
    Sheng, Hao
    Zhang, Yang
    Ke, Wei
    Xiong, Zhang
    [J]. 2018 IEEE 30TH INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE (ICTAI), 2018, : 532 - 539
  • [8] Enhancing Detection Model for Multiple Hypothesis Tracking
    Chen, Jiahui
    Sheng, Hao
    Zhang, Yang
    Xiong, Zhang
    [J]. 2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2017, : 2143 - 2152
  • [9] Online Multi-Object Tracking with Instance-Aware Tracker and Dynamic Model Refreshment
    Chu, Peng
    Fan, Heng
    Tan, Chiu C.
    Ling, Haibin
    [J]. 2019 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2019, : 161 - 170
  • [10] Pedestrian detection and tracking in infrared imagery using shape and appearance
    Dai, Congxia
    Zheng, Yunfei
    Li, Xin
    [J]. COMPUTER VISION AND IMAGE UNDERSTANDING, 2007, 106 (2-3) : 288 - 299