Unsupervised Domain Adaptation for Cross-Scene Multispectral Point Cloud Classification

被引:17
作者
Wang, Qingwang [1 ,2 ]
Wang, Mingye [1 ,2 ]
Huang, Jiangbo [1 ,2 ]
Liu, Tianzhu [3 ,4 ]
Shen, Tao [1 ,2 ]
Gu, Yanfeng [3 ,4 ]
机构
[1] Kunming Univ Sci & Technol, Fac Informat Engn & Automat, Kunming 650500, Peoples R China
[2] Kunming Univ Sci & Technol, Yunnan Key Lab Comp Technol Applicat, Kunming 650500, Peoples R China
[3] Harbin Inst Technol, Sch Elect & Informat Engn, Harbin 150001, Peoples R China
[4] Harbin Inst Technol, Heilongjiang Prov Key Lab Space Air Ground Integra, Harbin 150001, Peoples R China
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2024年 / 62卷
基金
中国国家自然科学基金;
关键词
Point cloud compression; Feature extraction; Transformers; Training; Three-dimensional displays; Entropy; Remote sensing; Cross-scene classification; graph convolutional network (GCN); multispectral point cloud classification; pseudo-label; unsupervised domain adaptive (UDA);
D O I
10.1109/TGRS.2024.3423759
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Remote sensing cross-scene classification has always been an important research field, especially in the field of 3-D classification, which is of great significance. Considering the diversity of collection conditions, seasons, and regional styles, deep learning networks well-trained on one source domain dataset tend to suffer from severe performance degradation when applied to other target domain datasets. To tackle the issue, in this article, we propose a new cross-scene classification method, which combines pre-alignment and Shannon entropy constraint to accomplish unsupervised domain adaptive classification (PS-UDA). On the one hand, the pre-alignment employs $L_{2}$ -paradigm constraint and Laplace matrix to pre-align the features. With the $L_{2}$ -paradigm constraint, the originally distant features of the source and target domain are constrained to the same sphere surface, and it is easier to make the distribution alignment on the sphere surface. Further, the Laplace matrix is used to map the source and target domain. In this way, similar features of the source and target domain are further aligned, and dissimilar features become discrete from each other. On the other hand, this article employs the Shannon entropy constraint to motivate the network to obtain more high-confidence target domain pseudo-labels. In addition, to fully utilize the unlabeled target domain information, the target domain features are augmented using the adjacency matrix. Experimental results of two cross-scene multispectral point cloud classifications demonstrate that the proposed PS-UDA can effectively mitigate the spectral shift issue in cross-scene multispectral point clouds, achieving state-of-the-art performance.
引用
收藏
页数:15
相关论文
共 48 条
[41]   Prototype-Guided Multitask Adversarial Network for Cross-Domain LiDAR Point Clouds Semantic Segmentation [J].
Yuan, Zhimin ;
Cheng, Ming ;
Zeng, Wankang ;
Su, Yanfei ;
Liu, Weiquan ;
Yu, Shangshu ;
Wang, Cheng .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
[42]   Prototypical Pseudo Label Denoising and Target Structure Learning for Domain Adaptive Semantic Segmentation [J].
Zhang, Pan ;
Zhang, Bo ;
Zhang, Ting ;
Chen, Dong ;
Wang, Yong ;
Wen, Fang .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :12409-12419
[43]   Cross-domain Correspondence Learning for Exemplar-based Image Translation [J].
Zhang, Pan ;
Zhang, Bo ;
Chen, Dong ;
Yuan, Lu ;
Wen, Fang .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, :5142-5152
[44]   Point Transformer [J].
Zhao, Hengshuang ;
Jiang, Li ;
Jia, Jiaya ;
Torr, Philip ;
Koltun, Vladlen .
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, :16239-16248
[45]   Airborne multispectral LiDAR point cloud classification with a feature Reasoning-based graph convolution network [J].
Zhao, Peiran ;
Guan, Haiyan ;
Li, Dilong ;
Yu, Yongtao ;
Wang, Hanyun ;
Gao, Kyle ;
Marcato Junior, Jose ;
Li, Jonathan .
INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION, 2021, 105
[46]   Unsupervised Domain Adaptation Semantic Segmentation of High-Resolution Remote Sensing Imagery With Invariant Domain-Level Prototype Memory [J].
Zhu, Jingru ;
Guo, Ya ;
Sun, Geng ;
Yang, Libo ;
Deng, Min ;
Chen, Jie .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
[47]  
Zou Y, 2018, LECT NOTES COMPUT SC, V11207, P297, DOI [10.1007/978-3-030-01219-9_18, 10.1007/978-3-030-01219-9_]
[48]   Confidence Regularized Self-Training [J].
Zou, Yang ;
Yu, Zhiding ;
Liu, Xiaofeng ;
Kumar, B. V. K. Vijaya ;
Wang, Jinsong .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :5981-5990