Unsupervised Domain Adaptation for Cross-Scene Multispectral Point Cloud Classification

被引:17
作者
Wang, Qingwang [1 ,2 ]
Wang, Mingye [1 ,2 ]
Huang, Jiangbo [1 ,2 ]
Liu, Tianzhu [3 ,4 ]
Shen, Tao [1 ,2 ]
Gu, Yanfeng [3 ,4 ]
机构
[1] Kunming Univ Sci & Technol, Fac Informat Engn & Automat, Kunming 650500, Peoples R China
[2] Kunming Univ Sci & Technol, Yunnan Key Lab Comp Technol Applicat, Kunming 650500, Peoples R China
[3] Harbin Inst Technol, Sch Elect & Informat Engn, Harbin 150001, Peoples R China
[4] Harbin Inst Technol, Heilongjiang Prov Key Lab Space Air Ground Integra, Harbin 150001, Peoples R China
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2024年 / 62卷
基金
中国国家自然科学基金;
关键词
Point cloud compression; Feature extraction; Transformers; Training; Three-dimensional displays; Entropy; Remote sensing; Cross-scene classification; graph convolutional network (GCN); multispectral point cloud classification; pseudo-label; unsupervised domain adaptive (UDA);
D O I
10.1109/TGRS.2024.3423759
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Remote sensing cross-scene classification has always been an important research field, especially in the field of 3-D classification, which is of great significance. Considering the diversity of collection conditions, seasons, and regional styles, deep learning networks well-trained on one source domain dataset tend to suffer from severe performance degradation when applied to other target domain datasets. To tackle the issue, in this article, we propose a new cross-scene classification method, which combines pre-alignment and Shannon entropy constraint to accomplish unsupervised domain adaptive classification (PS-UDA). On the one hand, the pre-alignment employs $L_{2}$ -paradigm constraint and Laplace matrix to pre-align the features. With the $L_{2}$ -paradigm constraint, the originally distant features of the source and target domain are constrained to the same sphere surface, and it is easier to make the distribution alignment on the sphere surface. Further, the Laplace matrix is used to map the source and target domain. In this way, similar features of the source and target domain are further aligned, and dissimilar features become discrete from each other. On the other hand, this article employs the Shannon entropy constraint to motivate the network to obtain more high-confidence target domain pseudo-labels. In addition, to fully utilize the unlabeled target domain information, the target domain features are augmented using the adjacency matrix. Experimental results of two cross-scene multispectral point cloud classifications demonstrate that the proposed PS-UDA can effectively mitigate the spectral shift issue in cross-scene multispectral point clouds, achieving state-of-the-art performance.
引用
收藏
页数:15
相关论文
共 48 条
[1]   Domain Adaptation With Contrastive Learning for Object Detection in Satellite Imagery [J].
Biswas, Debojyoti ;
Tesic, Jelena .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 :1-15
[2]   Unsupervised Domain Adaptation With Debiased Contrastive Learning and Support-Set Guided Pseudolabeling for Remote Sensing Images [J].
Biswas, Debojyoti ;
Tesic, Jelena .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 :3197-3210
[3]   All about Structure: Adapting Structural Information across Domains for Boosting Semantic Segmentation [J].
Chang, Wei-Lun ;
Wang, Hui-Po ;
Peng, Wen-Hsiao ;
Chiu, Wei-Chen .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :1900-1909
[4]   Self-Ensembling with GAN-based Data Augmentation for Domain Adaptation in Semantic Segmentation [J].
Choi, Jaehoon ;
Kim, Taekyung ;
Kim, Changick .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :6829-6839
[5]   Hierarchical contrastive adaptation for cross-domain object detection [J].
Deng, Ziwei ;
Kong, Quan ;
Akira, Naoto ;
Yoshinaga, Tomoaki .
MACHINE VISION AND APPLICATIONS, 2022, 33 (04)
[6]   Classification of Airborne Multispectral Lidar Point Clouds for Land Cover Mapping [J].
Ekhtari, Nima ;
Glennie, Craig ;
Fernandez-Diaz, Juan Carlos .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2018, 11 (06) :2068-2078
[7]   Translation of Aerial Image Into Digital Map via Discriminative Segmentation and Creative Generation [J].
Fu, Ying ;
Liang, Shuaizhe ;
Chen, Dongdong ;
Chen, Zhanlong .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
[8]  
Ganin Y, 2016, J MACH LEARN RES, V17
[9]  
Ganin Y, 2015, PR MACH LEARN RES, V37, P1180
[10]  
Gong BQ, 2012, PROC CVPR IEEE, P2066, DOI 10.1109/CVPR.2012.6247911