ContrastMotion: Self-supervised Scene Motion Learning for Large-Scale LiDAR Point Clouds

被引:0
|
作者
Jia, Xiangze [1 ]
Zhou, Hui [2 ]
Zhu, Xinge [2 ]
Guo, Yandong [3 ]
Zhang, Ji [1 ,4 ]
Ma, Yuexin [5 ]
机构
[1] Nanjing Univ Aeronaut & Astronaut, Nanjing, Peoples R China
[2] Chinese Univ Hong Kong, Hong Kong, Peoples R China
[3] OPPO Res Inst, Chengdu, Peoples R China
[4] Zhejiang Lab, Hangzhou, Peoples R China
[5] ShanghaiTech Univ, Shanghai, Peoples R China
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we propose a novel self-supervised motion estimator for LiDAR-based autonomous driving via BEV representation. Different from usually adopted self-supervised strategies for data-level structure consistency, we predict scene motion via feature-level consistency between pillars in consecutive frames, which can eliminate the effect caused by noise points and view-changing point clouds in dynamic scenes. Specifically, we propose Soft Discriminative Loss that provides the network with more pseudo-supervised signals to learn discriminative and robust features in a contrastive learning manner. We also propose Gated Multi-frame Fusion block that learns valid compensation between point cloud frames automatically to enhance feature extraction. Finally, pillar association is proposed to predict pillar correspondence probabilities based on feature distance, and whereby further predicts scene motion. Extensive experiments show the effectiveness and superiority of our ContrastMotion on both scene flow and motion prediction tasks.
引用
收藏
页码:929 / 937
页数:9
相关论文
共 50 条
  • [31] Occlusion Guided Self-supervised Scene Flow Estimation on 3D Point Clouds
    Ouyang, Bojun
    Raviv, Dan
    2021 INTERNATIONAL CONFERENCE ON 3D VISION (3DV 2021), 2021, : 782 - 791
  • [32] Joint data and feature augmentation for self-supervised representation learning on point clouds
    Lu, Zhuheng
    Dai, Yuewei
    Li, Weiqing
    Su, Zhiyong
    GRAPHICAL MODELS, 2023, 129
  • [33] Inter-Modal Masked Autoencoder for Self-Supervised Learning on Point Clouds
    Liu, Jiaming
    Wu, Yue
    Gong, Maoguo
    Liu, Zhixiao
    Miao, Qiguang
    Ma, Wenping
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 3897 - 3908
  • [34] Self-Supervised Learning of Local Features in 3D Point Clouds
    Thabet, Ali
    Alwassel, Humam
    Ghanem, Bernard
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2020), 2020, : 4048 - 4052
  • [35] Self-supervised Learning of Motion Capture
    Tung, Hsiao-Yu Fish
    Tung, Hsiao-Wei
    Yumer, Ersin
    Fragkiadaki, Katerina
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 30 (NIPS 2017), 2017, 30
  • [36] Self-Point-Flow: Self-Supervised Scene Flow Estimation from Point Clouds with Optimal Transport and Random Walk
    Li, Ruibo
    Lin, Guosheng
    Xie, Lihua
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 15572 - 15581
  • [37] Self-Supervised Learning on 3D Point Clouds by Learning Discrete Generative Models
    Eckart, Benjamin
    Yuan, Wentao
    Liu, Chao
    Kautz, Jan
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 8244 - 8253
  • [38] FEAR: Feature Extraction for Aerial Registration in large-scale LiDAR point clouds
    Graehling, Quinn
    Asari, Vijayan
    Varney, Nina
    MULTIMODAL IMAGE EXPLOITATION AND LEARNING 2021, 2021, 11734
  • [39] An Unsupervised Building Footprints Delineation Approach for Large-Scale LiDAR Point Clouds
    Xu, Xin
    30TH ACM SIGSPATIAL INTERNATIONAL CONFERENCE ON ADVANCES IN GEOGRAPHIC INFORMATION SYSTEMS, ACM SIGSPATIAL GIS 2022, 2022, : 788 - 791
  • [40] Self-Supervised Feature Learning from Partial Point Clouds via Pose Disentanglement
    Tsai, Meng-Shiun
    Chiang, Pei-Ze
    Tsai, Yi-Hsuan
    Chiu, Wei-Chen
    2022 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2022, : 1031 - 1038