Modeling Continuous Motion for 3D Point Cloud Object Tracking

被引:0
|
作者
Luo, Zhipeng [1 ,2 ]
Zhang, Gongjie [1 ]
Zhou, Changqing [3 ]
Wu, Zhonghua [3 ]
Tao, Qingyi [3 ]
Lu, Lewei [3 ]
Lu, Shijian [1 ]
机构
[1] Nanyang Technol Univ, S Lab, Singapore, Singapore
[2] Black Sesame Technol, Singapore, Singapore
[3] SenseTime Res, Singapore, Singapore
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The task of 3D single object tracking (SOT) with LiDAR point clouds is crucial for various applications, such as autonomous driving and robotics. However, existing approaches have primarily relied on appearance matching or motion modeling within only two successive frames, thereby overlooking the long-range continuous motion property of objects in 3D space. To address this issue, this paper presents a novel approach that views each tracklet as a continuous stream: at each timestamp, only the current frame is fed into the network to interact with multi-frame historical features stored in a memory bank, enabling efficient exploitation of sequential information. To achieve effective cross-frame message passing, a hybrid attention mechanism is designed to account for both long-range relation modeling and local geometric feature extraction. Furthermore, to enhance the utilization of multi-frame features for robust tracking, a contrastive sequence enhancement strategy is proposed, which uses ground truth tracklets to augment training sequences and promote discrimination against false positives in a contrastive manner. Extensive experiments demonstrate that the proposed method outperforms the state-of-the-art method by significant margins on multiple benchmarks.
引用
收藏
页码:4026 / 4034
页数:9
相关论文
共 50 条
  • [1] Context Matching-Guided Motion Modeling for 3D Point Cloud Object Tracking
    Nie, Jiahao
    Xu, Anqi
    Bao, Zhengyi
    He, Zhiwei
    Lv, Xudong
    Gao, Mingyu
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2025, 35 (03) : 2289 - 2300
  • [2] Bioinspired point cloud representation: 3D object tracking
    Sergio Orts-Escolano
    Jose Garcia-Rodriguez
    Miguel Cazorla
    Vicente Morell
    Jorge Azorin
    Marcelo Saval
    Alberto Garcia-Garcia
    Victor Villena
    Neural Computing and Applications, 2018, 29 : 663 - 672
  • [3] Bioinspired point cloud representation: 3D object tracking
    Orts-Escolano, Sergio
    Garcia-Rodriguez, Jose
    Cazorla, Miguel
    Morell, Vicente
    Azorin, Jorge
    Saval, Marcelo
    Garcia-Garcia, Alberto
    Villena, Victor
    NEURAL COMPUTING & APPLICATIONS, 2018, 29 (09): : 663 - 672
  • [4] Transferable Adversarial Attack on 3D Object Tracking in Point Cloud
    Liu, Xiaoqiong
    Lin, Yuewei
    Yang, Qing
    Fan, Heng
    MULTIMEDIA MODELING, MMM 2023, PT II, 2023, 13834 : 446 - 458
  • [5] PTTR: Relational 3D Point Cloud Object Tracking with Transformer
    Zhou, Changqing
    Luo, Zhipeng
    Luo, Yueru
    Liu, Tianrui
    Pan, Liang
    Cai, Zhongang
    Zhao, Haiyu
    Lu, Shijian
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 8521 - 8530
  • [6] Structure aware 3D single object tracking of point cloud
    Zhou, Xiaoyu
    Wang, Ling
    Yuan, Zhian
    Xu, Ke
    Ma, Yanxin
    JOURNAL OF ELECTRONIC IMAGING, 2021, 30 (04)
  • [7] Fast 3D Object Measurement Based on Point Cloud Modeling
    Wang, Gang
    Zhou, Mingliang
    Fang, Bin
    Zhang, Yugui
    Guan, Shouqin
    Ruan, Bin
    Li, Zelin
    INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2023, 37 (11)
  • [8] Implicit and Efficient Point Cloud Completion for 3D Single Object Tracking
    Wang, Pan
    Ren, Liangliang
    Wu, Shengkai
    Yang, Jinrong
    Yu, En
    Yu, Hangcheng
    Li, Xiaoping
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2023, 8 (04): : 1935 - 1942
  • [9] Exploring Point-BEV Fusion for 3D Point Cloud Object Tracking With Transformer
    Luo, Zhipeng
    Zhou, Changqing
    Pan, Liang
    Zhang, Gongjie
    Liu, Tianrui
    Luo, Yueru
    Zhao, Haiyu
    Liu, Ziwei
    Lu, Shijian
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2024, 46 (09) : 5921 - 5935
  • [10] Exploring Point-BEV Fusion for 3D Point Cloud Object Tracking with Transformer
    Luo, Zhipeng
    Zhou, Changqing
    Pan, Liang
    Zhang, Gongjie
    Liu, Tianrui
    Luo, Yueru
    Zhao, Haiyu
    Liu, Ziwei
    Lu, Shijian
    arXiv, 2022,