An Iterative Classification and Semantic Segmentation Network for Old Landslide Detection Using High-Resolution Remote Sensing Images

被引:14
作者
Lu, Zili [1 ]
Peng, Yuexing [1 ]
Li, Wei [2 ]
Yu, Junchuan [3 ]
Ge, Daqing [3 ]
Han, Lingyi [3 ]
Xiang, Wei [4 ]
机构
[1] Beijing Univ Posts & Telecommun, Sch Informat & Commun Engn, Key Lab Universal Wireless Commun, MOE, Beijing 100876, Peoples R China
[2] Beijing Inst Technol, Sch Informat & Elect, Beijing 100081, Peoples R China
[3] China Aero Geophys Survey & Remote Sensing Ctr Na, Dept Satellite Applicat Res, Beijing 100083, Peoples R China
[4] Trobe Univ, Sch Comp Engn & Math Sci, Melbourne, Vic 3086, Australia
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2023年 / 61卷
关键词
Terrain factors; Feature extraction; Semantic segmentation; Semantics; Reliability; Task analysis; Iterative methods; Contrastive learning; landslide detection; multitask learning; semantic segmentation; CONVOLUTIONAL NETWORKS; MULTISCALE;
D O I
10.1109/TGRS.2023.3313586
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
The geological characteristics of old landslides can provide crucial information for the task of landslide protection. However, detecting old landslides from high-resolution remote sensing images (HRSIs) is of great challenge due to their partially or strongly transformed morphology over a long time and thus the limited difference with their surroundings. Additionally, small-sized datasets can restrict in-depth learning. To address these challenges, this article proposes a new iterative classification and semantic segmentation network (ICSSN), which can significantly improve both object-level and pixel-level classification performance by iteratively upgrading the feature extraction module shared by the object classification and semantic segmentation networks. To improve the detection performance on small-sized datasets, object-level contrastive learning is employed in the object classification network featuring a siamese network to realize global features extraction, and a subobject-level contrastive learning (SOCL) method is designed in the semantic segmentation network to efficiently extract salient features from boundaries of landslides. An iterative training strategy is also proposed to fuse features in the semantic space, further improving both the object-level and pixel-level classification performances. The proposed ICSSN is evaluated on a real-world landslide dataset, and experimental results show that it greatly improves both the classification and segmentation accuracy of old landslides. For the semantic segmentation task, compared to the baseline, the F1 score increases from 0.5054 to 0.5448, the mean intersection over union (mIoU) improves from 0.6405 to 0.6610, the landslide IoU grows from 0.3381 to 0.3743, the pixel accuracy (PA) is improved from 0.945 to 0.949, and the object-level detection accuracy of old landslides surges from 0.55 to 0.90. For the object classification task, the F1 score increases from 0.8846 to 0.9230, and the accuracy score is up from 0.8375 to 0.8875.
引用
收藏
页数:13
相关论文
共 56 条
  • [1] Urban Green Space Planning Based on Remote Sensing and Geographic Information Systems
    Bai, Hua
    Li, Ziwei
    Guo, Hanlong
    Chen, Haopeng
    Luo, Pingping
    [J]. REMOTE SENSING, 2022, 14 (17)
  • [2] Object based image analysis for remote sensing
    Blaschke, T.
    [J]. ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2010, 65 (01) : 2 - 16
  • [3] Landslide Detection Using Densely Connected Convolutional Networks and Environmental Conditions
    Cai, Haojie
    Chen, Tao
    Niu, Ruiqing
    Plaza, Antonio
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2021, 14 : 5235 - 5247
  • [4] End-to-End DSM Fusion Networks for Semantic Segmentation in High-Resolution Aerial Images
    Cao, Zhiying
    Fu, Kun
    Lu, Xiaode
    Diao, Wenhui
    Sun, Hao
    Yan, Menglong
    Yu, Hongfeng
    Sun, Xian
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2019, 16 (11) : 1766 - 1770
  • [5] Landslide detection, monitoring and prediction with remote-sensing techniques
    Casagli, Nicola
    Intrieri, Emanuele
    Tofani, Veronica
    Gigli, Giovanni
    Raspini, Federico
    [J]. NATURE REVIEWS EARTH & ENVIRONMENT, 2023, 4 (01) : 51 - 64
  • [6] Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation
    Chen, Liang-Chieh
    Zhu, Yukun
    Papandreou, George
    Schroff, Florian
    Adam, Hartwig
    [J]. COMPUTER VISION - ECCV 2018, PT VII, 2018, 11211 : 833 - 851
  • [7] Landslide risk assessment and management: an overview
    Dai, FC
    Lee, CF
    Ngai, YY
    [J]. ENGINEERING GEOLOGY, 2002, 64 (01) : 65 - 87
  • [8] Landslide susceptibility prediction based on image semantic segmentation
    Du, Bowen
    Zhao, Zirong
    Hu, Xiao
    Wu, Guanghui
    Han, Liangzhe
    Sun, Leilei
    Gao, Qiang
    [J]. COMPUTERS & GEOSCIENCES, 2021, 155
  • [9] Duin R. P., 1995, P SCAND C IM AN SCIA, V2, P957
  • [10] GAN-Based Siamese Framework for Landslide Inventory Mapping Using Bi-Temporal Optical Remote Sensing Images
    Fang, Bo
    Chen, Gang
    Pan, Li
    Kou, Rong
    Wang, Lizhe
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2021, 18 (03) : 391 - 395