Self-ensembling for 3D point cloud domain adaptation

被引:0
|
作者
Li, Qing [1 ,4 ]
Peng, Xiaojiang [1 ]
Yan, Chuan [2 ]
Gao, Pan [3 ]
Hao, Qi [4 ]
机构
[1] Shenzhen Technol Univ, Coll Big data & Internet, Shenzhen 518118, Peoples R China
[2] George Mason Univ, Comp Sci & Engn, Fairfax, VA 22030 USA
[3] Nanjing Univ Aeronaut & Astronaut, Coll Comp Sci & Technol, Coll Artificial Intelligence, Nanjing 210016, Peoples R China
[4] Southern Univ Sci & Technol, Sch Comp Sci & Engn, Shenzhen 518055, Peoples R China
基金
中国国家自然科学基金;
关键词
3D point clouds; Unsupervised domain adaptation; SEN; Self-supervised learning;
D O I
10.1016/j.imavis.2024.105409
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recently 3D point cloud learning has been a hot topic in computer vision and autonomous driving. Due to the fact that it is difficult to manually annotate a qualitative large-scale 3D point cloud dataset, unsupervised domain adaptation (UDA) is popular in 3D point cloud learning which aims to transfer the learned knowledge from the labeled source domain to the unlabeled target domain. Existing methods mainly resort to a deformation reconstruction in the target domain, leveraging the deformable invariance process for generalization and domain adaptation. In this paper, we propose a conceptually new yet simple method, termed as selfensembling network (SEN) for domain generalization and adaptation. In SEN, we propose a soft classification loss on the source domain and a consistency loss on the target domain to stabilize the feature representations and to capture better invariance in the UDA task. In addition, we extend the pointmixup module on the target domain to increase the diversity of point clouds which further boosts cross domain generalization. Extensive experiments on several 3D point cloud UDA benchmarks show that our SEN outperforms the state-of-the-art methods on both classification and segmentation tasks.
引用
收藏
页数:9
相关论文
共 50 条
  • [41] 3D Domain Adaptive Instance Segmentation via Cyclic Segmentation GANs
    Lauenburg, Leander
    Lin, Zudi
    Zhang, Ruihan
    dos Santos, Marcia
    Huang, Siyu
    Arganda-Carreras, Ignacio
    Boyden, Edward S.
    Pfister, Hanspeter
    Wei, Donglai
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2023, 27 (08) : 4018 - 4027
  • [42] A Survey of Label-Efficient Deep Learning for 3D Point Clouds
    Xiao, Aoran
    Zhang, Xiaoqin
    Shao, Ling
    Lu, Shijian
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2024, 46 (12) : 9139 - 9160
  • [43] MonoTTA: Fully Test-Time Adaptation for Monocular 3D Object Detection
    Lin, Hongbin
    Zhang, Yifan
    Niu, Shuaicheng
    Cui, Shuguang
    Li, Zhen
    COMPUTER VISION-ECCV 2024, PT XLIV, 2025, 15102 : 96 - 114
  • [44] Self-supervised 3D Skeleton Completion for Vascular Structures
    Ren, Jiaxiang
    Li, Zhenghong
    Cheng, Wensheng
    Zou, Zhilin
    Park, Kicheon
    Pan, Yingtian
    Ling, Haibin
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2024, PT XI, 2024, 15011 : 579 - 589
  • [45] Self-Supervised Learning of Detailed 3D Face Reconstruction
    Chen, Yajing
    Wu, Fanzi
    Wang, Zeyu
    Song, Yibing
    Ling, Yonggen
    Bao, Linchao
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 : 8696 - 8705
  • [46] 3D Human Pose Machines with Self-Supervised Learning
    Wang, Keze
    Lin, Liang
    Jiang, Chenhan
    Qian, Chen
    Wei, Pengxu
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2020, 42 (05) : 1069 - 1082
  • [47] CMAE-3D: Contrastive Masked AutoEncoders for Self-Supervised 3D Object Detection
    Zhang, Yanan
    Chen, Jiaxin
    Huang, Di
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2025, 133 (05) : 2783 - 2804
  • [48] Hierarchical deep semantic alignment for cross-domain 3D model retrieval
    Song, Dan
    Ling, Yuting
    Li, Tianbao
    Wang, Teng
    Li, Xuanya
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2023, 95
  • [49] Curriculumformer: Taming Curriculum Pre-Training for Enhanced 3-D Point Cloud Understanding
    Fei, Ben
    Luo, Tianyue
    Yang, Weidong
    Liu, Liwen
    Zhang, Rui
    He, Ying
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, : 1 - 15
  • [50] ACCURATE 3D KIDNEY SEGMENTATION USING UNSUPERVISED DOMAIN TRANSLATION AND ADVERSARIAL NETWORKS
    Zeng, Wankang
    Fan, Wenkang
    Chen, Rong
    Zheng, Zhuohui
    Zheng, Song
    Chen, Jianhui
    Liu, Rong
    Zeng, Qiang
    Liu, Zengqin
    Chen, Yinran
    Luo, Xiongbiao
    2021 IEEE 18TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (ISBI), 2021, : 598 - 602