Self-ensembling for 3D point cloud domain adaptation

被引:0
|
作者
Li, Qing [1 ,4 ]
Peng, Xiaojiang [1 ]
Yan, Chuan [2 ]
Gao, Pan [3 ]
Hao, Qi [4 ]
机构
[1] Shenzhen Technol Univ, Coll Big data & Internet, Shenzhen 518118, Peoples R China
[2] George Mason Univ, Comp Sci & Engn, Fairfax, VA 22030 USA
[3] Nanjing Univ Aeronaut & Astronaut, Coll Comp Sci & Technol, Coll Artificial Intelligence, Nanjing 210016, Peoples R China
[4] Southern Univ Sci & Technol, Sch Comp Sci & Engn, Shenzhen 518055, Peoples R China
基金
中国国家自然科学基金;
关键词
3D point clouds; Unsupervised domain adaptation; SEN; Self-supervised learning;
D O I
10.1016/j.imavis.2024.105409
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recently 3D point cloud learning has been a hot topic in computer vision and autonomous driving. Due to the fact that it is difficult to manually annotate a qualitative large-scale 3D point cloud dataset, unsupervised domain adaptation (UDA) is popular in 3D point cloud learning which aims to transfer the learned knowledge from the labeled source domain to the unlabeled target domain. Existing methods mainly resort to a deformation reconstruction in the target domain, leveraging the deformable invariance process for generalization and domain adaptation. In this paper, we propose a conceptually new yet simple method, termed as selfensembling network (SEN) for domain generalization and adaptation. In SEN, we propose a soft classification loss on the source domain and a consistency loss on the target domain to stabilize the feature representations and to capture better invariance in the UDA task. In addition, we extend the pointmixup module on the target domain to increase the diversity of point clouds which further boosts cross domain generalization. Extensive experiments on several 3D point cloud UDA benchmarks show that our SEN outperforms the state-of-the-art methods on both classification and segmentation tasks.
引用
收藏
页数:9
相关论文
共 50 条
  • [31] Simulation-to-Reality Domain Adaptation for Offline 3D Object Annotation on Pointclouds with Correlation Alignment
    Zhang, Weishuang
    Kiran, B. Ravi
    Gauthier, Thomas
    Mazouz, Yanis
    Steger, Theo
    IMPROVE: PROCEEDINGS OF THE 2ND INTERNATIONAL CONFERENCE ON IMAGE PROCESSING AND VISION ENGINEERING, 2022, : 142 - 149
  • [32] Weighted unsupervised domain adaptation considering geometry features and engineering performance of 3D design data
    Shin, Seungyeon
    Kang, Namwoo
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 256
  • [33] PLS: UNSUPERVISED DOMAIN ADAPTATION FOR 3D OBJECT DETECTION VIA PSEUDO-LABEL SIZES
    Chen, Shijie
    Wang, Rongquan
    Li, Xin
    Wu, Yuchen
    Liu, Haizhuang
    Chen, Jiansheng
    Ma, Huimin
    2024 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING, ICASSP 2024, 2024, : 6370 - 6374
  • [34] DCCN: A dual-cross contrastive neural network for 3D point cloud representation learning
    Wu, Xiaopeng
    Shi, Guangsi
    Zhao, Zexing
    Li, Mingjie
    Gao, Xiaojun
    Yan, Xiaoli
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 249
  • [35] A Siamese-Transport Domain Adaptation Framework for 3D MRI Classification of Gliomas and Alzheimer's Diseases
    Yu, Luyue
    Liu, Ju
    Wu, Qiang
    Wang, Jing
    Qu, Aixi
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2024, 28 (01) : 391 - 402
  • [36] Cross-modal Unsupervised Domain Adaptation for 3D Semantic Segmentation via Bidirectional Fusion-then-Distillation
    Wu, Yao
    Xing, Mingwei
    Zhang, Yachao
    Xie, Yuan
    Fan, Jianping
    Shi, Zhongchao
    Qu, Yanyun
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 490 - 498
  • [37] Domain Adaptive LiDAR Point Cloud Segmentation via Density-Aware Self-Training
    Xiao, Aoran
    Huang, Jiaxing
    Liu, Kangcheng
    Guan, Dayan
    Zhang, Xiaoqin
    Lu, Shijian
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2024, 25 (10) : 13627 - 13639
  • [38] 3D SCENEFLOWNET: SELF-SUPERVISED 3D SCENE FLOWESTIMATION BASED ON GRAPH CNN
    Lu, Yawen
    Zhu, Yuhao
    Lu, Guoyu
    2021 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2021, : 3647 - 3651
  • [39] Self-supervised learning of rotation-invariant 3D point set features using transformer and its self-distillation
    Furuya, Takahiko
    Chen, Zhoujie
    Ohbuchi, Ryutarou
    Kuang, Zhenzhong
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2024, 244
  • [40] PointVST: Self-Supervised Pre-Training for 3D Point Clouds via View-Specific Point-to-Image Translation
    Zhang, Qijian
    Hou, Junhui
    IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2024, 30 (10) : 6900 - 6912