Boosting End-to-end Multi-Object Tracking and Person Search via Knowledge Distillation

被引:10
作者
Zhang, Wei [1 ,3 ]
He, Lingxiao [2 ]
Cheng, Peng [2 ]
Liao, Xingyu [2 ]
Liu, Wu [2 ]
Li, Qi [1 ]
Sun, Zhenan [1 ]
机构
[1] CASIA, CRIPAC & NLPR, Beijing, Peoples R China
[2] JD AI Res, Beijing, Peoples R China
[3] Univ Chinese Acad Sci, Sch Artificial Intelligence, Beijing, Peoples R China
来源
PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021 | 2021年
基金
中国国家自然科学基金; 国家重点研发计划;
关键词
Multi-object tracking; Person search; End-to-end strategy; Knowledge; distillation; MULTITARGET;
D O I
10.1145/3474085.3481546
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Multi-Object Tracking (MOT) and Person Search both demand to localize and identify specific targets from raw image frames. Existing methods can be classified into two categories, namely twostep strategy and end-to-end strategy. Two-step approaches have high accuracy but suffer from costly computations, while end-toend methods show greater efficiency with limited performance. In this paper, we dissect the gap between two-step and end-to-end strategy and propose a simple yet effective end-to-end framework with knowledge distillation. Our proposed framework is simple in concept and easy to benefit from external datasets. Experimental results demonstrate that our model performs competitively with other sophisticated two-step and end-to-end methods in multiobject tracking and person search.
引用
收藏
页码:1192 / 1201
页数:10
相关论文
共 50 条
  • [1] Joint Detection and Association for End-to-End Multi-object Tracking
    Li, Ye
    Luo, Xiaoyu
    Shi, Junyu
    Wang, Xinzhong
    Yin, Guangqiang
    Wang, Zhiguo
    NEURAL PROCESSING LETTERS, 2023, 55 (09) : 11823 - 11844
  • [2] Joint Detection and Association for End-to-End Multi-object Tracking
    Ye Li
    Xiaoyu Luo
    Junyu Shi
    Xinzhong Wang
    Guangqiang Yin
    Zhiguo Wang
    Neural Processing Letters, 2023, 55 : 11823 - 11844
  • [3] Tracking Beyond Detection: Learning a Global Response Map for End-to-End Multi-Object Tracking
    Wan, Xingyu
    Cao, Jiakai
    Zhou, Sanping
    Wang, Jinjun
    Zheng, Nanning
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 8222 - 8235
  • [4] End-to-End Chained Pedestrian Multi-Object Tracking Based on Multi-Feature Fusion
    Zhou, Haiyun
    Xiang, Xuezhi
    Wang, Xinyao
    Ren, Wenkai
    PROCEEDINGS OF 2021 IEEE 12TH INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING AND SERVICE SCIENCE (ICSESS), 2021, : 150 - 153
  • [5] An end-to-end identity association network based on geometry refinement for multi-object tracking
    Li, Rui
    Zhang, Baopeng
    Teng, Zhu
    Fan, Jianping
    PATTERN RECOGNITION, 2022, 129
  • [6] Looking Beyond Two Frames: End-to-End Multi-Object Tracking Using Spatial and Temporal Transformers
    Zhu, Tianyu
    Hiller, Markus
    Ehsanpour, Mahsa
    Ma, Rongkai
    Drummond, Tom
    Reid, Ian
    Rezatofighi, Hamid
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (11) : 12783 - 12797
  • [7] PANet: An End-to-end Network Based on Relative Motion for Online Multi-object Tracking
    Li, Rui
    Zhang, Baopeng
    Liu, Wei
    Teng, Zhu
    Fan, Jianping
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2023, 19 (06)
  • [8] End to End Multi-object Tracking Algorithm Applied to Vehicle Tracking
    Qin, Wenyuan
    Du, Hong
    Zhang, Xiaozheng
    Ren, Xuebing
    2022 ASIA CONFERENCE ON ALGORITHMS, COMPUTING AND MACHINE LEARNING (CACML 2022), 2022, : 367 - 372
  • [9] End-to-End Learning Deep CRF Models for Multi-Object Tracking Deep CRF Models
    Xiang, Jun
    Xu, Guohan
    Ma, Chao
    Hou, Jianhua
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2021, 31 (01) : 275 - 288
  • [10] An end to end trained hybrid CNN model for multi-object tracking
    Divya Singh
    Rajeev Srivastava
    Multimedia Tools and Applications, 2022, 81 : 42209 - 42221