A Multi-Object Tracking Algorithm With Center-Based Feature Extraction and Occlusion Handling

被引:27
作者
Cao, Zhengcai [1 ]
Li, Junnian [1 ]
Zhang, Dong [1 ]
Zhou, Mengchu [2 ]
Abusorrah, Abdullah [3 ]
机构
[1] Beijing Univ Chem Technol, Coll Informat Sci & Technol, Beijing 100029, Peoples R China
[2] New Jersey Inst Technol, Dept Elect & Comp Engn, Newark, NJ 07102 USA
[3] King Abdulaziz Univ, K A CARE Energy Res & Innovat Ctr, Jeddah 21589, Saudi Arabia
基金
中国国家自然科学基金; 北京市自然科学基金;
关键词
Feature extraction; Object detection; Heating systems; Three-dimensional displays; Logic gates; Videos; Training; Multi-object tracking; center-based feature extraction; ConvGRU; Hungarian matching; OBJECT TRACKING;
D O I
10.1109/TITS.2022.3229978
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
For tracking suspicious objects using intelligent robots, Multiple Object Tracking (MOT) has gained great attention. MOT is easily affected by long-term severe occlusion. This work proposes a joint MOT algorithm to handle such occlusion. Pairs of frames in complicated environments are taken as input. A center-based feature extraction framework is designed for precisely detecting objects and extracting their feature maps. A ConvGRU module is applied to learn permanent representations by using historical spatio-temporal information of objects. A Hungarian matching method is applied to match the detected objects and predicted predictions. The proposed algorithm is compared with several representative methods on two public multi-object tracking benchmarks. Furthermore, this work constructs a database with videos captured from street scenarios and uses it to test the proposed algorithm and its peers. Experimental results demonstrate that the proposed algorithm outperforms its peers, especially under long-term severe occlusion, thus advancing the field of MOT.
引用
收藏
页码:4464 / 4473
页数:10
相关论文
共 49 条
[1]   Towards Collaborative Robotics in Top View Surveillance: A Framework for Multiple Object Tracking by Detection Using Deep Learning [J].
Ahmed, Imran ;
Din, Sadia ;
Jeon, Gwanggil ;
Piccialli, Francesco ;
Fortino, Giancarlo .
IEEE-CAA JOURNAL OF AUTOMATICA SINICA, 2021, 8 (07) :1253-1270
[2]   Tracking without bells and whistles [J].
Bergmann, Philipp ;
Meinhardt, Tim ;
Leal-Taixe, Laura .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :941-951
[3]   Evaluating Multiple Object Tracking Performance: The CLEAR MOT Metrics [J].
Bernardin, Keni ;
Stiefelhagen, Rainer .
EURASIP JOURNAL ON IMAGE AND VIDEO PROCESSING, 2008, 2008 (1)
[4]   Direction Control and Adaptive Path Following of 3-D Snake-Like Robot Motion [J].
Cao, Zhengcai ;
Zhang, Dong ;
Zhou, MengChu .
IEEE TRANSACTIONS ON CYBERNETICS, 2022, 52 (10) :10980-10987
[5]   Rapid Detection of Blind Roads and Crosswalks by Using a Lightweight Semantic Segmentation Network [J].
Cao, Zhengcai ;
Xu, Xiaowen ;
Hu, Biao ;
Zhou, MengChu .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2021, 22 (10) :6188-6197
[6]   Distributed Fusion-Based Policy Search for Fast Robot Locomotion Learning [J].
Cao, Zhengcai ;
Xiao, Qing ;
Zhou, Mengchu .
IEEE COMPUTATIONAL INTELLIGENCE MAGAZINE, 2019, 14 (03) :19-28
[7]   Real-time gesture recognition based on feature recalibration network with multi-scale information [J].
Cao, Zhengcai ;
Xu, Xiaowen ;
Hu, Biao ;
Zhou, Meng ;
Li, Qinglin .
NEUROCOMPUTING, 2019, 347 :119-130
[8]   Distributed Multi-Target Tracking in Camera Networks [J].
Casao, Sara ;
Naya, Abel ;
Murillo, Ana C. ;
Montijano, Eduardo .
2021 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2021), 2021, :1903-1909
[9]  
Chung JY, 2015, PR MACH LEARN RES, V37, P2067
[10]   Deep learning in video multi-object tracking: A survey [J].
Ciaparrone, Gioele ;
Luque Sanchez, Francisco ;
Tabik, Siham ;
Troiano, Luigi ;
Tagliaferri, Roberto ;
Herrera, Francisco .
NEUROCOMPUTING, 2020, 381 :61-88