Weakly supervised high spatial resolution land cover mapping based on self-training with weighted pseudo-labels

被引:14
作者
Liu, Wei [1 ]
Liu, Jiawei [1 ]
Luo, Zhipeng [2 ]
Zhang, Hongbin [1 ]
Gao, Kyle [3 ]
Li, Jonathan [3 ]
机构
[1] East China Jiaotong Univ, Sch Software, Nanchang 330013, Peoples R China
[2] Hong Kong Polytech Univ, Dept Land Surveying & Geo Informat, Hong Kong 999077, Peoples R China
[3] Univ Waterloo, Dept Geog & Environm Management, Waterloo, ON N2L 3G1, Canada
基金
中国国家自然科学基金;
关键词
Unsupervised domain adaptation; Land cover mapping; Self-training; Pseudo-learning; Semantic segmentation; UNSUPERVISED DOMAIN ADAPTATION;
D O I
10.1016/j.jag.2022.102931
中图分类号
TP7 [遥感技术];
学科分类号
081102 ; 0816 ; 081602 ; 083002 ; 1404 ;
摘要
Despite its success, deep learning in land cover mapping requires a massive amount of pixel-wise labeled images. It typically assumes that the training and test scenes are similar in data distribution. The performance of models trained on any particular dataset could degrade significantly on a new dataset due to the domain shift or domain gap across datasets, resulting in new training data requiring labor-intensive manual pixel-wise labeling. This paper proposes a land cover mapping framework combining Feature Pyramid Network (FPN) and self-training. In the FPN, we integrate ConvNeXt with a Pyramid Pooling Module (PPM). Combining the FPN and the PPM improves the segmentation performance, which benefits from the multiscale aggregation of pyramid features. To fully exploit pseudo-labels, we design an Unsupervised Domain Adaptation (UDA) land cover mapping scheme with self-training using weighted pseudo-labels of the target samples. The proposed land cover mapping framework could benefit from multiscale aggregation of pyramid features and the full use of the pseudo-labels. Comparison results on the LoveDA dataset, the latest large-scale unsupervised domain adaptation dataset for land cover mapping, empirically demonstrated that our land cover mapping approach significantly outperforms the baselines in both UDA scenarios, i.e., Urban-* Rural and Rural-* Urban. The models of this paper are now publicly available on GitHub.1
引用
收藏
页数:9
相关论文
共 50 条
[1]  
Bengio Y., 2009, P 26 ANN INT C MACH, P41, DOI DOI 10.1145/1553374.1553380
[2]   Unsupervised Domain Adaptation Using Generative Adversarial Networks for Semantic Segmentation of Aerial Images [J].
Benjdira, Bilel ;
Bazi, Yakoub ;
Koubaa, Anis ;
Ouni, Kais .
REMOTE SENSING, 2019, 11 (11)
[3]  
Cai Y., REMOTE SENS-BASEL, V14, P190
[4]  
Cascante-Bonilla P, 2021, AAAI CONF ARTIF INTE, V35, P6912
[5]   DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs [J].
Chen, Liang-Chieh ;
Papandreou, George ;
Kokkinos, Iasonas ;
Murphy, Kevin ;
Yuille, Alan L. .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (04) :834-848
[6]   Domain Adaptation for Semantic Segmentation with Maximum Squares Loss [J].
Chen, Minghao ;
Xue, Hongyang ;
Cai, Deng .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :2090-2099
[7]  
Choi J., 2019, P BRIT MACH VIS C BM, P1
[8]   Self-Ensembling with GAN-based Data Augmentation for Domain Adaptation in Semantic Segmentation [J].
Choi, Jaehoon ;
Kim, Taekyung ;
Kim, Changick .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :6829-6839
[9]   Curriculum Model Adaptation with Synthetic and Real Data for Semantic Foggy Scene Understanding [J].
Dai, Dengxin ;
Sakaridis, Christos ;
Hecker, Simon ;
Van Gool, Luc .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2020, 128 (05) :1182-1204
[10]  
Deng XQ, 2019, INT GEOSCI REMOTE SE, P4955, DOI [10.1109/IGARSS.2019.8900277, 10.1109/igarss.2019.8900277]