Motion-to-Matching: A Mixed Paradigm for 3D Single Object Tracking

被引:1
|
作者
Li, Zhiheng [1 ,2 ,3 ]
Lin, Yu [1 ]
Cui, Yubo [1 ]
Li, Shuo [1 ]
Fang, Zheng [1 ,2 ,3 ]
机构
[1] Northeastern Univ, Fac Robot Sci & Engn, Shenyang 110819, Peoples R China
[2] Northeastern Univ, Natl Frontiers Sci Ctr Ind Intelligence & Syst Opt, Shenyang 110819, Peoples R China
[3] Northeastern Univ, Key Lab Data Analyt & Optimizat Smart Ind, Minist Educ, Shenyang 110819, Peoples R China
基金
中国国家自然科学基金;
关键词
Target tracking; Three-dimensional displays; Feature extraction; Point cloud compression; Transformers; Object tracking; Image matching; 3D object tracking; deep learning; point clouds;
D O I
10.1109/LRA.2023.3347143
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
3D single object tracking with LiDAR points is an important task in the computer vision field. Previous methods usually adopt the matching-based or motion-centric paradigms to estimate the current target status. However, the former is sensitive to the similar distractors and the sparseness of point clouds due to relying on appearance matching, while the latter usually focuses on short-term motion clues (eg. two frames) and ignores the long-term motion pattern of target. To address these issues, we propose a mixed paradigm with two stages, named MTM-Tracker, which combines motion modeling with feature matching into a single network. Specifically, in the first stage, we exploit the continuous historical boxes as motion prior and propose an encoder-decoder structure to locate target coarsely. Then, in the second stage, we introduce a feature interaction module to extract motion-aware features from consecutive point clouds and match them to refine target movement as well as regress other target states. Extensive experiments validate that our paradigm achieves competitive performance on large-scale datasets (70.9% in KITTI and 51.70% in NuScenes).
引用
收藏
页码:1468 / 1475
页数:8
相关论文
共 50 条
  • [21] A Framework for 3D Object Identification and Tracking
    Chliveros, Georgios
    Figueiredo, Rui P.
    Moreno, Plinio
    Pateraki, Maria
    Bernardino, Alexandre
    Santos-Victor, Jose
    Trahanias, Panos
    PROCEEDINGS OF THE 2014 9TH INTERNATIONAL CONFERENCE ON COMPUTER VISION, THEORY AND APPLICATIONS (VISAPP 2014), VOL 3, 2014, : 672 - 677
  • [22] Monocular 3D Object Detection With Motion Feature Distillation
    Hu, Henan
    Li, Muyu
    Zhu, Ming
    Gao, Wen
    Liu, Peiyu
    Chan, Kwok-Leung
    IEEE ACCESS, 2023, 11 : 82933 - 82945
  • [23] Multi-Modal 3D Object Detection by Box Matching
    Liu, Zhe
    Ye, Xiaoqing
    Zou, Zhikang
    He, Xinwei
    Tan, Xiao
    Ding, Errui
    Wang, Jingdong
    Bai, Xiang
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2024,
  • [24] 3D LiDAR Multi-Object Tracking Using Multi Positive Contrastive Learning and Deep Reinforcement Learning
    Cho, Minho
    Kim, Euntai
    IEEE ACCESS, 2025, 13 : 12447 - 12457
  • [25] An Efficient Ungrouped Mask Method With two Learnable Parameters for 3D Object Detection
    Guo, Shuai
    Shi, Lei
    Jiang, Xiaoheng
    Lv, Pei
    Liu, Qidong
    Hu, Yazhou
    Ji, Rongrong
    Xu, Mingliang
    IEEE TRANSACTIONS ON MULTIMEDIA, 2025, 27 : 1003 - 1017
  • [26] 3D Extended Object Tracking Using Recursive Gaussian Processes
    Kumru, Murat
    Ozkan, Emre
    2018 21ST INTERNATIONAL CONFERENCE ON INFORMATION FUSION (FUSION), 2018, : 259 - 266
  • [27] Robust object tracking techniques for vision-based 3D motion analysis applications
    Knyaz, Vladimir A.
    Zheltov, Sergey Yu.
    Vishnyakov, Boris V.
    OPTICS, PHOTONICS AND DIGITAL TECHNOLOGIES FOR IMAGING APPLICATIONS IV, 2016, 9896
  • [28] Deep learning based object tracking for 3D microstructure reconstruction
    Ma, Boyuan
    Xu, Yuting
    Chen, Jiahao
    Puquan, Pan
    Ban, Xiaojuan
    Wang, Hao
    Xue, Weihua
    METHODS, 2022, 204 : 172 - 178
  • [29] Exploiting More Information in Sparse Point Cloud for 3D Single Object Tracking
    Cui, Yubo
    Shan, Jiayao
    Gu, Zuoxu
    Li, Zhiheng
    Fang, Zheng
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2022, 7 (04) : 11926 - 11933
  • [30] REAL-TIME 3D OBJECT TRACKING
    STEPHENS, RS
    IMAGE AND VISION COMPUTING, 1990, 8 (01) : 91 - 96