Self-ensembling for 3D point cloud domain adaptation

被引:0
|
作者
Li, Qing [1 ,4 ]
Peng, Xiaojiang [1 ]
Yan, Chuan [2 ]
Gao, Pan [3 ]
Hao, Qi [4 ]
机构
[1] Shenzhen Technol Univ, Coll Big data & Internet, Shenzhen 518118, Peoples R China
[2] George Mason Univ, Comp Sci & Engn, Fairfax, VA 22030 USA
[3] Nanjing Univ Aeronaut & Astronaut, Coll Comp Sci & Technol, Coll Artificial Intelligence, Nanjing 210016, Peoples R China
[4] Southern Univ Sci & Technol, Sch Comp Sci & Engn, Shenzhen 518055, Peoples R China
基金
中国国家自然科学基金;
关键词
3D point clouds; Unsupervised domain adaptation; SEN; Self-supervised learning;
D O I
10.1016/j.imavis.2024.105409
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recently 3D point cloud learning has been a hot topic in computer vision and autonomous driving. Due to the fact that it is difficult to manually annotate a qualitative large-scale 3D point cloud dataset, unsupervised domain adaptation (UDA) is popular in 3D point cloud learning which aims to transfer the learned knowledge from the labeled source domain to the unlabeled target domain. Existing methods mainly resort to a deformation reconstruction in the target domain, leveraging the deformable invariance process for generalization and domain adaptation. In this paper, we propose a conceptually new yet simple method, termed as selfensembling network (SEN) for domain generalization and adaptation. In SEN, we propose a soft classification loss on the source domain and a consistency loss on the target domain to stabilize the feature representations and to capture better invariance in the UDA task. In addition, we extend the pointmixup module on the target domain to increase the diversity of point clouds which further boosts cross domain generalization. Extensive experiments on several 3D point cloud UDA benchmarks show that our SEN outperforms the state-of-the-art methods on both classification and segmentation tasks.
引用
收藏
页数:9
相关论文
共 50 条
  • [21] CoSMix: Compositional Semantic Mix for Domain Adaptation in 3D LiDAR Segmentation
    Saltori, Cristiano
    Galasso, Fabio
    Fiameni, Giuseppe
    Sebe, Nicu
    Ricci, Elisa
    Poiesi, Fabio
    COMPUTER VISION - ECCV 2022, PT XXXIII, 2022, 13693 : 586 - 602
  • [22] Single View 3D Point Cloud Reconstruction using Novel View Synthesis and Self-Supervised Depth Estimation
    Johnston, Adrian
    Carneiro, Gustavo
    2019 DIGITAL IMAGE COMPUTING: TECHNIQUES AND APPLICATIONS (DICTA), 2019, : 208 - 215
  • [23] Unsupervised Domain Adaptation for Vertebrae Detection and Identification in 3D CT Volumes Using a Domain Sanity Loss
    Sager, Pascal
    Salzmann, Sebastian
    Burn, Felice
    Stadelmann, Thilo
    JOURNAL OF IMAGING, 2022, 8 (08)
  • [24] Cross-Domain and Cross-Modal Knowledge Distillation in Domain Adaptation for 3D Semantic Segmentation
    Li, Miaoyu
    Zhang, Yachao
    Xie, Yuan
    Gao, Zuodong
    Li, Cuihua
    Zhang, Zhizhong
    Qu, Yanyun
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 3829 - 3837
  • [25] Advancing 3D point cloud understanding through deep transfer learning: A comprehensive survey
    Sohail, Shahab Saquib
    Himeur, Yassine
    Kheddar, Hamza
    Amira, Abbes
    Fadli, Fodil
    Atalla, Shadi
    Copiaco, Igail
    INFORMATION FUSION, 2025, 113
  • [26] BALANCING REPRESENTATION ABSTRACTIONS AND LOCAL DETAILS PRESERVATION FOR 3D POINT CLOUD QUALITY ASSESSMENT
    Tliba, Marouane
    Chetouani, Aladine
    Valenzise, Giuseppe
    Dufaux, Frederic
    2024 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING, ICASSP 2024, 2024, : 4335 - 4339
  • [27] End-to-End Visual Domain Adaptation Network for Cross-Domain 3D CPS Data Retrieval
    Liu, An-An
    Xiang, Shu
    Nie, Wei-Zhi
    Song, Dan
    IEEE ACCESS, 2019, 7 : 118630 - 118638
  • [28] Target-Specific Domain Adaptation via Geometry-Correlation Prediction for Point Cloud
    Li, Junqiao
    Zhu, Leyan
    Wang, Tian
    Xie, Yuan
    Xia, Jingang
    Snoussi, Hichem
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2024, PT IV, 2025, 15034 : 47 - 61
  • [29] A Novel 3D Unsupervised Domain Adaptation Framework for Cross-Modality Medical Image Segmentation
    Yao, Kai
    Su, Zixian
    Huang, Kaizhu
    Yang, Xi
    Sun, Jie
    Hussain, Amir
    Coenen, Frans
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2022, 26 (10) : 4976 - 4986
  • [30] Metric Learning-Based Unsupervised Domain Adaptation for 3D Skeleton Hand Activities Categorization
    Boutaleb, Yasser
    Soladie, Catherine
    Duong, Nam-duong
    Kacete, Amine
    Royan, Jerome
    Seguier, Renaud
    IMAGE ANALYSIS AND PROCESSING, ICIAP 2022, PT III, 2022, 13233 : 62 - 74