Motion-to-Matching: A Mixed Paradigm for 3D Single Object Tracking

被引:1
|
作者
Li, Zhiheng [1 ,2 ,3 ]
Lin, Yu [1 ]
Cui, Yubo [1 ]
Li, Shuo [1 ]
Fang, Zheng [1 ,2 ,3 ]
机构
[1] Northeastern Univ, Fac Robot Sci & Engn, Shenyang 110819, Peoples R China
[2] Northeastern Univ, Natl Frontiers Sci Ctr Ind Intelligence & Syst Opt, Shenyang 110819, Peoples R China
[3] Northeastern Univ, Key Lab Data Analyt & Optimizat Smart Ind, Minist Educ, Shenyang 110819, Peoples R China
基金
中国国家自然科学基金;
关键词
Target tracking; Three-dimensional displays; Feature extraction; Point cloud compression; Transformers; Object tracking; Image matching; 3D object tracking; deep learning; point clouds;
D O I
10.1109/LRA.2023.3347143
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
3D single object tracking with LiDAR points is an important task in the computer vision field. Previous methods usually adopt the matching-based or motion-centric paradigms to estimate the current target status. However, the former is sensitive to the similar distractors and the sparseness of point clouds due to relying on appearance matching, while the latter usually focuses on short-term motion clues (eg. two frames) and ignores the long-term motion pattern of target. To address these issues, we propose a mixed paradigm with two stages, named MTM-Tracker, which combines motion modeling with feature matching into a single network. Specifically, in the first stage, we exploit the continuous historical boxes as motion prior and propose an encoder-decoder structure to locate target coarsely. Then, in the second stage, we introduce a feature interaction module to extract motion-aware features from consecutive point clouds and match them to refine target movement as well as regress other target states. Extensive experiments validate that our paradigm achieves competitive performance on large-scale datasets (70.9% in KITTI and 51.70% in NuScenes).
引用
收藏
页码:1468 / 1475
页数:8
相关论文
共 50 条
  • [1] TM2B: Transformer-Based Motion-to-Box Network for 3D Single Object Tracking on Point Clouds
    Xu, Anqi
    Nie, Jiahao
    He, Zhiwei
    Lv, Xudong
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2024, 9 (08): : 7078 - 7085
  • [2] OST: Efficient One-Stream Network for 3D Single Object Tracking in Point Clouds
    Zhao, Xiantong
    Han, Yinan
    Tian, Shengjing
    Liu, Jian
    Liu, Xiuping
    IEEE TRANSACTIONS ON MULTIMEDIA, 2025, 27 : 990 - 1002
  • [3] Integrating Scaling Strategy and Central Guided Voting for 3D Point Cloud Object Tracking
    Fan, Baojie
    Zhou, Wuyang
    Yang, Yushi
    Tian, Jiandong
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2024, 9 (04) : 3940 - 3947
  • [4] MMF-Track: Multi-Modal Multi-Level Fusion for 3D Single Object Tracking
    Li, Zhiheng
    Cui, Yubo
    Lin, Yu
    Fang, Zheng
    IEEE TRANSACTIONS ON INTELLIGENT VEHICLES, 2024, 9 (01): : 1817 - 1829
  • [5] 3D OBJECT TRACKING AND MOTION SHAPE RECOGNITION
    Amirgaliyev, Y. N.
    Nussipbekov, A. K.
    BULLETIN OF THE NATIONAL ACADEMY OF SCIENCES OF THE REPUBLIC OF KAZAKHSTAN, 2014, (02): : 21 - 24
  • [6] Exploring Point-BEV Fusion for 3D Point Cloud Object Tracking With Transformer
    Luo, Zhipeng
    Zhou, Changqing
    Pan, Liang
    Zhang, Gongjie
    Liu, Tianrui
    Luo, Yueru
    Zhao, Haiyu
    Liu, Ziwei
    Lu, Shijian
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2024, 46 (09) : 5921 - 5935
  • [7] A Lightweight and Detector-Free 3D Single Object Tracker on Point Clouds
    Xia, Yan
    Wu, Qiangqiang
    Li, Wei
    Chan, Antoni B. B.
    Stilla, Uwe
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2023, 24 (05) : 5543 - 5554
  • [8] Multi-Level Structure-Enhanced Network for 3D Single Object Tracking in Sparse Point Clouds
    Wu, Qiaoyun
    Sun, Changyin
    Wang, Jun
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2023, 8 (01) : 9 - 16
  • [9] Probabilistic 3D motion model for object tracking in aerial applications
    Mirtajadini, Seyed Hojat
    Atashgah, MohammadAli Amiri
    Shahbazi, Mohammad
    IET IMAGE PROCESSING, 2024, 18 (08) : 2011 - 2027
  • [10] AnchorPoint: Query Design for Transformer-Based 3D Object Detection and Tracking
    Liu, Hao
    Ma, Yanni
    Wang, Hanyun
    Zhang, Chaobo
    Guo, Yulan
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2023, 24 (10) : 10988 - 11000