Motion-to-Matching: A Mixed Paradigm for 3D Single Object Tracking

被引:1
|
作者
Li, Zhiheng [1 ,2 ,3 ]
Lin, Yu [1 ]
Cui, Yubo [1 ]
Li, Shuo [1 ]
Fang, Zheng [1 ,2 ,3 ]
机构
[1] Northeastern Univ, Fac Robot Sci & Engn, Shenyang 110819, Peoples R China
[2] Northeastern Univ, Natl Frontiers Sci Ctr Ind Intelligence & Syst Opt, Shenyang 110819, Peoples R China
[3] Northeastern Univ, Key Lab Data Analyt & Optimizat Smart Ind, Minist Educ, Shenyang 110819, Peoples R China
基金
中国国家自然科学基金;
关键词
Target tracking; Three-dimensional displays; Feature extraction; Point cloud compression; Transformers; Object tracking; Image matching; 3D object tracking; deep learning; point clouds;
D O I
10.1109/LRA.2023.3347143
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
3D single object tracking with LiDAR points is an important task in the computer vision field. Previous methods usually adopt the matching-based or motion-centric paradigms to estimate the current target status. However, the former is sensitive to the similar distractors and the sparseness of point clouds due to relying on appearance matching, while the latter usually focuses on short-term motion clues (eg. two frames) and ignores the long-term motion pattern of target. To address these issues, we propose a mixed paradigm with two stages, named MTM-Tracker, which combines motion modeling with feature matching into a single network. Specifically, in the first stage, we exploit the continuous historical boxes as motion prior and propose an encoder-decoder structure to locate target coarsely. Then, in the second stage, we introduce a feature interaction module to extract motion-aware features from consecutive point clouds and match them to refine target movement as well as regress other target states. Extensive experiments validate that our paradigm achieves competitive performance on large-scale datasets (70.9% in KITTI and 51.70% in NuScenes).
引用
收藏
页码:1468 / 1475
页数:8
相关论文
共 50 条
  • [41] Oriented and Directional Chamfer Distance Losses for 3D Object Reconstruction From a Single Image
    Lu, Jinxiao
    Li, Zhizhen
    Bai, Jiquan
    Yu, Qian
    IEEE ACCESS, 2022, 10 : 61631 - 61638
  • [42] Bioinspired point cloud representation: 3D object tracking
    Sergio Orts-Escolano
    Jose Garcia-Rodriguez
    Miguel Cazorla
    Vicente Morell
    Jorge Azorin
    Marcelo Saval
    Alberto Garcia-Garcia
    Victor Villena
    Neural Computing and Applications, 2018, 29 : 663 - 672
  • [43] Bioinspired point cloud representation: 3D object tracking
    Orts-Escolano, Sergio
    Garcia-Rodriguez, Jose
    Cazorla, Miguel
    Morell, Vicente
    Azorin, Jorge
    Saval, Marcelo
    Garcia-Garcia, Alberto
    Villena, Victor
    NEURAL COMPUTING & APPLICATIONS, 2018, 29 (09): : 663 - 672
  • [44] Integrated Object Segmentation and Tracking for 3D LIDAR Data
    Tuncer, Mehmet Ali Cagri
    Schulz, Dirk
    ICINCO: PROCEEDINGS OF THE 13TH INTERNATIONAL CONFERENCE ON INFORMATICS IN CONTROL, AUTOMATION AND ROBOTICS, VOL 2, 2016, : 344 - 351
  • [45] 3D object tracking by using virtual viewpoint images
    Seimitsu Kogaku Kaishi, 12 (1194-1199):
  • [46] CMT: Context-Matching-Guided Transformer for 3D Tracking in Point Clouds
    Guo, Zhiyang
    Mao, Yunyao
    Zhou, Wengang
    Wang, Min
    Li, Houqiang
    COMPUTER VISION, ECCV 2022, PT XXII, 2022, 13682 : 95 - 111
  • [47] S.T.A.R.-Track: Latent Motion Models for End-to-End 3D Object Tracking With Adaptive Spatio-Temporal Appearance Representations
    Doll, Simon
    Hanselmann, Niklas
    Schneider, Lukas
    Schulz, Richard
    Enzweiler, Markus
    Lensch, Hendrik P. A.
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2024, 9 (02) : 1326 - 1333
  • [48] BEVFusion With Dual Hard Instance Probing for Multimodal 3D Object Detection
    Kim, Taeho
    Kim, Joohee
    IEEE ACCESS, 2025, 13 : 25546 - 25556
  • [49] Constructing 3D Object Detectors Based on Deformable Convolutional Guided Depths
    Zheng, Xinwang
    Yang, Guangsong
    Yang, Lu
    Lu, Chengyu
    IEEE ACCESS, 2024, 12 : 162990 - 163000
  • [50] mmMCL3DMOT: Multi-Modal Momentum Contrastive Learning for 3D Multi-Object Tracking
    Hong, Ru
    Yang, Jiming
    Zhou, Weidian
    Da, Feipeng
    IEEE SIGNAL PROCESSING LETTERS, 2024, 31 : 1895 - 1899