ContrastMotion: Self-supervised Scene Motion Learning for Large-Scale LiDAR Point Clouds

被引:0
|
作者
Jia, Xiangze [1 ]
Zhou, Hui [2 ]
Zhu, Xinge [2 ]
Guo, Yandong [3 ]
Zhang, Ji [1 ,4 ]
Ma, Yuexin [5 ]
机构
[1] Nanjing Univ Aeronaut & Astronaut, Nanjing, Peoples R China
[2] Chinese Univ Hong Kong, Hong Kong, Peoples R China
[3] OPPO Res Inst, Chengdu, Peoples R China
[4] Zhejiang Lab, Hangzhou, Peoples R China
[5] ShanghaiTech Univ, Shanghai, Peoples R China
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we propose a novel self-supervised motion estimator for LiDAR-based autonomous driving via BEV representation. Different from usually adopted self-supervised strategies for data-level structure consistency, we predict scene motion via feature-level consistency between pillars in consecutive frames, which can eliminate the effect caused by noise points and view-changing point clouds in dynamic scenes. Specifically, we propose Soft Discriminative Loss that provides the network with more pseudo-supervised signals to learn discriminative and robust features in a contrastive learning manner. We also propose Gated Multi-frame Fusion block that learns valid compensation between point cloud frames automatically to enhance feature extraction. Finally, pillar association is proposed to predict pillar correspondence probabilities based on feature distance, and whereby further predicts scene motion. Extensive experiments show the effectiveness and superiority of our ContrastMotion on both scene flow and motion prediction tasks.
引用
收藏
页码:929 / 937
页数:9
相关论文
共 50 条
  • [1] Self-Supervised Pretraining for Large-Scale Point Clouds
    Zhang, Zaiwei
    Bai, Min
    Li, Erran
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
  • [2] PointMotionNet: Point-Wise Motion Learning for Large-Scale LiDAR Point Clouds Sequences
    Wang, Jun
    Li, Xiaolong
    Sullivan, Alan
    Abbott, Lynn
    Chen, Siheng
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2022, 2022, : 4418 - 4427
  • [3] Self-supervised Learning for Large-scale Item Recommendations
    Yao, Tiansheng
    Yi, Xinyang
    Cheng, Derek Zhiyuan
    Yu, Felix
    Chen, Ting
    Menon, Aditya
    Hong, Lichan
    Chi, Ed H.
    Tjoa, Steve
    Kang, Jieqi
    Ettinger, Evan
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON INFORMATION & KNOWLEDGE MANAGEMENT, CIKM 2021, 2021, : 4321 - 4330
  • [4] SLIM: Self-Supervised LiDAR Scene Flow and Motion Segmentation
    Baur, Stefan Andreas
    Emmerichs, David Josef
    Moosmann, Frank
    Pinggera, Peter
    Ommer, Bjoern
    Geiger, Andreas
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 13106 - 13116
  • [5] RigidFlow: Self-Supervised Scene Flow Learning on Point Clouds by Local Rigidity Prior
    Li, Ruibo
    Zhang, Chi
    Lin, Guosheng
    Wang, Zhe
    Shen, Chunhua
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 16938 - 16947
  • [6] Self-supervised contrastive representation learning for large-scale trajectories
    Li, Shuzhe
    Chen, Wei
    Yan, Bingqi
    Li, Zhen
    Zhu, Shunzhi
    Yu, Yanwei
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2023, 148 : 357 - 366
  • [7] Automated Large-Scale Cell Annotation with Self-Supervised Learning
    Tang, Yuan Xi
    Huan, Le
    Xia, Can
    Lin, Fulai
    Zhao, Yundi
    JOURNAL OF THE AMERICAN COLLEGE OF SURGEONS, 2024, 239 (05) : S182 - S182
  • [8] An Unsupervised Learning Network for Large-Scale LiDAR Point Clouds Registration
    Liu, Jingbin
    Lv, Xuanfan
    Gong, Xiaodong
    Liang, Yifan
    Hyyppa, Juha
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2024, 73 (11) : 16187 - 16200
  • [9] DeepMapping2: Self-Supervised Large-Scale LiDAR Map Optimization
    Chen, Chao
    Liu, Xinhao
    Li, Yiming
    Ding, Li
    Feng, Chen
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 9306 - 9316
  • [10] Masked Discrimination for Self-supervised Learning on Point Clouds
    Liu, Haotian
    Cai, Mu
    Lee, Yong Jae
    COMPUTER VISION - ECCV 2022, PT II, 2022, 13662 : 657 - 675