Distribution-aware contrastive learning for domain adaptation in 3D LiDAR segmentation

被引:0
作者
El Mendili, Lamiae [1 ]
Daniel, Sylvie [1 ]
Badard, Thierry [1 ]
机构
[1] Univ Laval, Dept Geomat Sci, 1055 Ave Seminaire, Quebec City, PQ G1V 0A6, Canada
基金
加拿大自然科学与工程研究理事会;
关键词
Unsupervised domain adaptation; 3D semantic segmentation; Contrastive learning; Maximum mean discrepancy; SEMANTIC SEGMENTATION;
D O I
10.1016/j.cviu.2025.104438
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Semantic segmentation of 3D LiDAR point clouds is very important for applications like autonomous driving and digital twins of cities. However, current deep learning models suffer from a significant generalization gap. Unsupervised Domain Adaptation methods have recently emerged to tackle this issue. While domain-invariant feature learning using Maximum Mean Discrepancy has shown promise for images due to its simplicity, its application remains unexplored in outdoor mobile mapping point clouds. Moreover, previous methods do not consider the class information, which can lead to suboptimal adaptation performance. We propose a new approach-Contrastive Maximum Mean Discrepancy-to maximize intra-class domain alignment and minimize inter-class domain discrepancy, and integrate it into a 3D semantic segmentation model for LiDAR point clouds. The evaluation of our method with large-scale UDA datasets shows that it surpasses state-of-the-art UDA approaches for 3D LiDAR point clouds. CMMD is a promising UDA approach with strong potential for point cloud semantic segmentation.
引用
收藏
页数:11
相关论文
共 48 条
[1]   SemanticKITTI: A Dataset for Semantic Scene Understanding of LiDAR Sequences [J].
Behley, Jens ;
Garbade, Martin ;
Milioto, Andres ;
Quenzel, Jan ;
Behnke, Sven ;
Stachniss, Cyrill ;
Gall, Juergen .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :9296-9306
[2]   nuScenes: A multimodal dataset for autonomous driving [J].
Caesar, Holger ;
Bankiti, Varun ;
Lang, Alex H. ;
Vora, Sourabh ;
Liong, Venice Erin ;
Xu, Qiang ;
Krishnan, Anush ;
Pan, Yu ;
Baldan, Giancarlo ;
Beijbom, Oscar .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2020), 2020, :11618-11628
[3]   All about Structure: Adapting Structural Information across Domains for Boosting Semantic Segmentation [J].
Chang, Wei-Lun ;
Wang, Hui-Po ;
Peng, Wen-Hsiao ;
Chiu, Wei-Chen .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :1900-1909
[4]   CrDoCo: Pixel-level Domain Transfer with Cross-Domain Consistency [J].
Chen, Yun-Chun ;
Lin, Yen-Yu ;
Yang, Ming-Hsuan ;
Huang, Jia-Bin .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :1791-1800
[5]   4D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networks [J].
Choy, Christopher ;
Gwak, JunYoung ;
Savarese, Silvio .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :3070-3079
[6]  
Gretton A, 2012, J MACH LEARN RES, V13, P723
[7]   Momentum Contrast for Unsupervised Visual Representation Learning [J].
He, Kaiming ;
Fan, Haoqi ;
Wu, Yuxin ;
Xie, Saining ;
Girshick, Ross .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2020), 2020, :9726-9735
[8]  
Hoffer E., 2014, INT WORKSH SIM BAS P
[9]  
Hoffman J, 2018, PR MACH LEARN RES, V80
[10]   Exploring Data-Efficient 3D Scene Understanding with Contrastive Scene Contexts [J].
Hou, Ji ;
Graham, Benjamin ;
Niesner, Matthias ;
Xie, Saining .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :15582-15592