ContrastMotion: Self-supervised Scene Motion Learning for Large-Scale LiDAR Point Clouds

被引:0
|
作者
Jia, Xiangze [1 ]
Zhou, Hui [2 ]
Zhu, Xinge [2 ]
Guo, Yandong [3 ]
Zhang, Ji [1 ,4 ]
Ma, Yuexin [5 ]
机构
[1] Nanjing Univ Aeronaut & Astronaut, Nanjing, Peoples R China
[2] Chinese Univ Hong Kong, Hong Kong, Peoples R China
[3] OPPO Res Inst, Chengdu, Peoples R China
[4] Zhejiang Lab, Hangzhou, Peoples R China
[5] ShanghaiTech Univ, Shanghai, Peoples R China
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we propose a novel self-supervised motion estimator for LiDAR-based autonomous driving via BEV representation. Different from usually adopted self-supervised strategies for data-level structure consistency, we predict scene motion via feature-level consistency between pillars in consecutive frames, which can eliminate the effect caused by noise points and view-changing point clouds in dynamic scenes. Specifically, we propose Soft Discriminative Loss that provides the network with more pseudo-supervised signals to learn discriminative and robust features in a contrastive learning manner. We also propose Gated Multi-frame Fusion block that learns valid compensation between point cloud frames automatically to enhance feature extraction. Finally, pillar association is proposed to predict pillar correspondence probabilities based on feature distance, and whereby further predicts scene motion. Extensive experiments show the effectiveness and superiority of our ContrastMotion on both scene flow and motion prediction tasks.
引用
收藏
页码:929 / 937
页数:9
相关论文
共 50 条
  • [21] Point2Vec for Self-supervised Representation Learning on Point Clouds
    Abou Zeid, Karim
    Schult, Jonas
    Hermans, Alexander
    Leibe, Bastian
    PATTERN RECOGNITION, DAGM GCPR 2023, 2024, 14264 : 131 - 146
  • [22] Self-Supervised Arbitrary-Scale Implicit Point Clouds Upsampling
    Zhao, Wenbo
    Liu, Xianming
    Zhai, Deming
    Jiang, Junjun
    Ji, Xiangyang
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (10) : 12394 - 12407
  • [23] LARGE-SCALE SELF-SUPERVISED SPEECH REPRESENTATION LEARNING FOR AUTOMATIC SPEAKER VERIFICATION
    Chen, Zhengyang
    Chen, Sanyuan
    Wu, Yu
    Qian, Yao
    Wang, Chengyi
    Liu, Shujie
    Qian, Yanmin
    Zeng, Michael
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 6147 - 6151
  • [24] Large-Scale Self-Supervised Human Activity Recognition
    Zadeh, Mohammad Zaki
    Jaiswal, Ashish
    Pavel, Hamza Reza
    Hebri, Aref
    Kapoor, Rithik
    Makedon, Fillia
    PROCEEDINGS OF THE 15TH INTERNATIONAL CONFERENCE ON PERVASIVE TECHNOLOGIES RELATED TO ASSISTIVE ENVIRONMENTS, PETRA 2022, 2022, : 298 - 299
  • [25] Self-supervised latent feature learning for partial point clouds recognition
    Zhang, Ziyu
    Da, Feipeng
    PATTERN RECOGNITION LETTERS, 2023, 176 : 49 - 55
  • [26] Self-supervised cognitive learning for multifaced interest in large-scale industrial recommender systems
    Wang, Yingshuai
    Zhang, Dezheng
    Wulamu, Aziguli
    INFORMATION SCIENCES, 2025, 686
  • [27] BrainMass: Advancing Brain Network Analysis for Diagnosis With Large-Scale Self-Supervised Learning
    Yang, Yanwu
    Ye, Chenfei
    Su, Guinan
    Zhang, Ziyao
    Chang, Zhikai
    Chen, Hairui
    Chan, Piu
    Yu, Yue
    Ma, Ting
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2024, 43 (11) : 4004 - 4016
  • [28] Self-Supervised Graph Transformer on Large-Scale Molecular Data
    Rong, Yu
    Bian, Yatao
    Xu, Tingyang
    Xie, Weiyang
    Wei, Ying
    Huang, Wenbing
    Huang, Junzhou
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 33, NEURIPS 2020, 2020, 33
  • [29] Large-scale inventory in natural forests with mobile LiDAR point clouds
    Shao, Jinyuan
    Lin, Yi-Chun
    Wingren, Cameron
    Shin, Sang-Yeop
    Fei, William
    Carpenter, Joshua
    Habib, Ayman
    Fei, Songlin
    SCIENCE OF REMOTE SENSING, 2024, 10
  • [30] TOWARDS ACCURATE INSTANCE SEGMENTATION IN LARGE-SCALE LIDAR POINT CLOUDS
    Xiang, Binbin
    Peters, Torben
    Kontogianni, Theodora
    Vetterli, Frawa
    Puliti, Stefano
    Astrup, Rasmus
    Schindler, Konrad
    GEOSPATIAL WEEK 2023, VOL. 10-1, 2023, : 605 - 612