Self-ensembling for 3D point cloud domain adaptation

被引:0
|
作者
Li, Qing [1 ,4 ]
Peng, Xiaojiang [1 ]
Yan, Chuan [2 ]
Gao, Pan [3 ]
Hao, Qi [4 ]
机构
[1] Shenzhen Technol Univ, Coll Big data & Internet, Shenzhen 518118, Peoples R China
[2] George Mason Univ, Comp Sci & Engn, Fairfax, VA 22030 USA
[3] Nanjing Univ Aeronaut & Astronaut, Coll Comp Sci & Technol, Coll Artificial Intelligence, Nanjing 210016, Peoples R China
[4] Southern Univ Sci & Technol, Sch Comp Sci & Engn, Shenzhen 518055, Peoples R China
基金
中国国家自然科学基金;
关键词
3D point clouds; Unsupervised domain adaptation; SEN; Self-supervised learning;
D O I
10.1016/j.imavis.2024.105409
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recently 3D point cloud learning has been a hot topic in computer vision and autonomous driving. Due to the fact that it is difficult to manually annotate a qualitative large-scale 3D point cloud dataset, unsupervised domain adaptation (UDA) is popular in 3D point cloud learning which aims to transfer the learned knowledge from the labeled source domain to the unlabeled target domain. Existing methods mainly resort to a deformation reconstruction in the target domain, leveraging the deformable invariance process for generalization and domain adaptation. In this paper, we propose a conceptually new yet simple method, termed as selfensembling network (SEN) for domain generalization and adaptation. In SEN, we propose a soft classification loss on the source domain and a consistency loss on the target domain to stabilize the feature representations and to capture better invariance in the UDA task. In addition, we extend the pointmixup module on the target domain to increase the diversity of point clouds which further boosts cross domain generalization. Extensive experiments on several 3D point cloud UDA benchmarks show that our SEN outperforms the state-of-the-art methods on both classification and segmentation tasks.
引用
收藏
页数:9
相关论文
共 50 条
  • [1] Unsupervised Domain Adaptation for the Histopathological Cell Segmentation through Self-Ensembling
    Li, Chaoqun
    Zhou, Yitian
    Shi, Tangqi
    Wu, Yenan
    Yang, Meng
    Li, Zhongyu
    MICCAI WORKSHOP ON COMPUTATIONAL PATHOLOGY, VOL 156, 2021, 156 : 151 - 158
  • [2] Self-ensembling with mask-boundary domain adaptation for optic disc and cup segmentation
    He, Yanlin
    Kong, Jun
    Liu, Di
    Li, Juan
    Zheng, Caixia
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2024, 129
  • [3] Point Cloud Domain Adaptation via Masked Local 3D Structure Prediction
    Liang, Hanxue
    Fan, Hehe
    Fan, Zhiwen
    Wang, Yi
    Chen, Tianlong
    Cheng, Yu
    Wang, Zhangyang
    COMPUTER VISION - ECCV 2022, PT III, 2022, 13663 : 156 - 172
  • [4] Self-Supervised Boundary Point Prediction Task for Point Cloud Domain Adaptation
    Chen, Jintao
    Zhang, Yan
    Huang, Kun
    Ma, Feifan
    Tan, Zhuangbin
    Xu, Zheyu
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2023, 8 (09) : 5878 - 5885
  • [5] GENERATION FOR UNSUPERVISED DOMAIN ADAPTATION: A GAN-BASED APPROACH FOR OBJECT CLASSIFICATION WITH 3D POINT CLOUD DATA
    Huang, Junxuan
    Yuan, Junsong
    Qiao, Chunming
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 3753 - 3757
  • [6] S 3 Net: Self-Supervised Self-Ensembling Network for Semi-Supervised RGB-D Salient Object Detection
    Zhu, Lei
    Wang, Xiaoqiang
    Li, Ping
    Yang, Xin
    Zhang, Qing
    Wang, Weiming
    Schonlieb, Carola-Bibiane
    Chen, C. L. Philip
    IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 676 - 689
  • [7] Exploring Self-Supervised Learning for 3D Point Cloud Registration
    Yuan, Mingzhi
    Huang, Qiao
    Shen, Ao
    Huang, Xiaoshui
    Wang, Manning
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2025, 10 (01): : 25 - 31
  • [8] SIRA-PCR: Sim-to-Real Adaptation for 3D Point Cloud Registration
    Chen, Suyi
    Xu, Hao
    Li, Ru
    Liu, Guanghui
    Fu, Chi-Wing
    Liu, Shuaicheng
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 14348 - 14359
  • [9] Unsupervised Domain Adaptation for 3D Object Detection via Self-Training
    Luo, Di
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2023, PT II, 2024, 14426 : 307 - 318
  • [10] PatchMixing Masked Autoencoders for 3D Point Cloud Self-Supervised Learning
    Lin, Chengxing
    Xu, Wenju
    Zhu, Jian
    Nie, Yongwei
    Cai, Ruichu
    Xu, Xuemiao
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (10) : 9882 - 9897