Weakly supervised high spatial resolution land cover mapping based on self-training with weighted pseudo-labels

被引:12
作者
Liu, Wei [1 ]
Liu, Jiawei [1 ]
Luo, Zhipeng [2 ]
Zhang, Hongbin [1 ]
Gao, Kyle [3 ]
Li, Jonathan [3 ]
机构
[1] East China Jiaotong Univ, Sch Software, Nanchang 330013, Peoples R China
[2] Hong Kong Polytech Univ, Dept Land Surveying & Geo Informat, Hong Kong 999077, Peoples R China
[3] Univ Waterloo, Dept Geog & Environm Management, Waterloo, ON N2L 3G1, Canada
基金
中国国家自然科学基金;
关键词
Unsupervised domain adaptation; Land cover mapping; Self-training; Pseudo-learning; Semantic segmentation; UNSUPERVISED DOMAIN ADAPTATION;
D O I
10.1016/j.jag.2022.102931
中图分类号
TP7 [遥感技术];
学科分类号
081102 ; 0816 ; 081602 ; 083002 ; 1404 ;
摘要
Despite its success, deep learning in land cover mapping requires a massive amount of pixel-wise labeled images. It typically assumes that the training and test scenes are similar in data distribution. The performance of models trained on any particular dataset could degrade significantly on a new dataset due to the domain shift or domain gap across datasets, resulting in new training data requiring labor-intensive manual pixel-wise labeling. This paper proposes a land cover mapping framework combining Feature Pyramid Network (FPN) and self-training. In the FPN, we integrate ConvNeXt with a Pyramid Pooling Module (PPM). Combining the FPN and the PPM improves the segmentation performance, which benefits from the multiscale aggregation of pyramid features. To fully exploit pseudo-labels, we design an Unsupervised Domain Adaptation (UDA) land cover mapping scheme with self-training using weighted pseudo-labels of the target samples. The proposed land cover mapping framework could benefit from multiscale aggregation of pyramid features and the full use of the pseudo-labels. Comparison results on the LoveDA dataset, the latest large-scale unsupervised domain adaptation dataset for land cover mapping, empirically demonstrated that our land cover mapping approach significantly outperforms the baselines in both UDA scenarios, i.e., Urban-* Rural and Rural-* Urban. The models of this paper are now publicly available on GitHub.1
引用
收藏
页数:9
相关论文
共 50 条
  • [1] Bengio Y., 2009, P 26 ANN INT C MACHI, P41
  • [2] Unsupervised Domain Adaptation Using Generative Adversarial Networks for Semantic Segmentation of Aerial Images
    Benjdira, Bilel
    Bazi, Yakoub
    Koubaa, Anis
    Ouni, Kais
    [J]. REMOTE SENSING, 2019, 11 (11)
  • [3] Cai Y., REMOTE SENS-BASEL, V14, P190
  • [4] Cascante-Bonilla P, 2021, AAAI CONF ARTIF INTE, V35, P6912
  • [5] DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs
    Chen, Liang-Chieh
    Papandreou, George
    Kokkinos, Iasonas
    Murphy, Kevin
    Yuille, Alan L.
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (04) : 834 - 848
  • [6] Domain Adaptation for Semantic Segmentation with Maximum Squares Loss
    Chen, Minghao
    Xue, Hongyang
    Cai, Deng
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 2090 - 2099
  • [7] Choi J., 2019, P BRIT MACH VIS C BM, P1
  • [8] Self-Ensembling with GAN-based Data Augmentation for Domain Adaptation in Semantic Segmentation
    Choi, Jaehoon
    Kim, Taekyung
    Kim, Changick
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 6829 - 6839
  • [9] Curriculum Model Adaptation with Synthetic and Real Data for Semantic Foggy Scene Understanding
    Dai, Dengxin
    Sakaridis, Christos
    Hecker, Simon
    Van Gool, Luc
    [J]. INTERNATIONAL JOURNAL OF COMPUTER VISION, 2020, 128 (05) : 1182 - 1204
  • [10] Deng XQ, 2019, INT GEOSCI REMOTE SE, P4955, DOI [10.1109/IGARSS.2019.8900277, 10.1109/igarss.2019.8900277]