MFFENet and ADANet: a robust deep transfer learning method and its application in high precision and fast cross-scene recognition of earthquake-induced landslides

被引:40
作者
Xu, Qingsong [1 ,3 ]
Ouyang, Chaojun [1 ,2 ,3 ]
Jiang, Tianhai [1 ]
Yuan, Xin [4 ]
Fan, Xuanmei [5 ]
Cheng, Duoxiang [6 ]
机构
[1] Chinese Acad Sci, Inst Mt Hazards & Environm, Key Lab Mt Hazards & Surface Proc, Chengdu 610041, Peoples R China
[2] Chinese Acad Sci, CAS Ctr Excellence Tibetan Plateau Earth Sci, Beijing 100101, Peoples R China
[3] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
[4] Westlake Univ, Hangzhou 310024, Peoples R China
[5] Chengdu Univ Technol, State Key Lab Geohazard Prevent & Geoenvironm Pro, Chengdu 610059, Peoples R China
[6] Sichuan Geomat Ctr, Sichuan Engn Res Ctr Emergency Mapping & Disaster, Chengdu 610041, Peoples R China
关键词
Earthquake-induced landslide recognition; Deep learning; Unsupervised domain adaptation; Multi-scale Feature Fusion with Encoder-decoder Network (MFFENet); Adversarial Domain Adaptation Network (ADANet); Landslide spatial analysis; REMOTE-SENSING IMAGES; FULLY CONVOLUTIONAL NETWORKS; CHANGE VECTOR ANALYSIS; SEMANTIC SEGMENTATION; DOMAIN ADAPTATION; CLASSIFICATION; AERIAL; INVENTORIES; MULTISENSOR; CHALLENGES;
D O I
10.1007/s10346-022-01847-1
中图分类号
P5 [地质学];
学科分类号
0709 ; 081803 ;
摘要
Automatic recognition and segmentation methods have become an essential requirement in identifying large-scale earthquake-induced landslides. This used to be conducted through pixel-based or object-oriented methods. However, these methods fail to develop an accurate, rapid, and cross-scene solution for earthquake-induced landslide recognition because of the massive amount of remote sensing data and variations in different earthquake scenarios. To fill this research gap, this paper proposes a robust deep transfer learning scheme for high precision and fast recognition of regional landslides. First, a Multi-scale Feature Fusion regime with an Encoder-decoder Network (MFFENet) is proposed to extract and fuse the multi-scale features of objects in remote sensing images, in which a novel and practical Adaptive Triangle Fork (ATF) Module is designed to integrate the useful features across different scales effectively. Second, an Adversarial Domain Adaptation Network (ADANet) is developed to perform different seismic landslide recognition tasks, and a multi-level output space adaptation scheme is proposed to enhance the adaptability of the segmentation model. Experimental results on standard remote sensing datasets demonstrate the effectiveness of MFFENet and ADANet. Finally, a comprehensive and general scheme is proposed for earthquake-induced landslide recognition, which integrates image features extracted from MFFENet and ADANet with the side information including landslide geologic features, bi-temporal changing features, and spatial analysis. The proposed scheme is applied in two earthquake-induced landslides in Jiuzhaigou (China) and Hokkaido (Japan), using available pre- and post-earthquake remote sensing images. These experiments show that the proposed scheme presents a state-of-the-art performance in regional landslide identification and performs stably and robustly in different seismic landslide recognition tasks. Our proposed framework demonstrates a competitive performance for high-precision, high-efficiency, and cross-scene recognition of earthquake disasters, which may serve as a new starting point for the application of deep learning and transfer learning methods in earthquake-induced landslide recognition.
引用
收藏
页码:1617 / 1647
页数:31
相关论文
共 109 条
[1]   High spatial resolution satellite imagery, DEM derivatives, and image segmentation for the detection of mass wasting processes [J].
Barlow, John ;
Franklin, Steven ;
Martin, Yvonne .
PHOTOGRAMMETRIC ENGINEERING AND REMOTE SENSING, 2006, 72 (06) :687-692
[2]   Siamese-GAN: Learning Invariant Representations for Aerial Vehicle Image Categorization [J].
Bashmal, Laila ;
Bazi, Yakoub ;
AlHichri, Haikel ;
AlRahhal, Mohamad M. ;
Ammour, Nassim ;
Alajlan, Naif .
REMOTE SENSING, 2018, 10 (02)
[3]   A theory of learning from different domains [J].
Ben-David, Shai ;
Blitzer, John ;
Crammer, Koby ;
Kulesza, Alex ;
Pereira, Fernando ;
Vaughan, Jennifer Wortman .
MACHINE LEARNING, 2010, 79 (1-2) :151-175
[4]   Unsupervised Domain Adaptation Using Generative Adversarial Networks for Semantic Segmentation of Aerial Images [J].
Benjdira, Bilel ;
Bazi, Yakoub ;
Koubaa, Anis ;
Ouni, Kais .
REMOTE SENSING, 2019, 11 (11)
[5]   Dense Decoder Shortcut Connections for Single-Pass Semantic Segmentation [J].
Bilinski, Piotr ;
Prisacariu, Victor .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :6596-6605
[6]   Comparison between automated and manual mapping of typhoon-triggered landslides from SPOT-5 imagery [J].
Borghuis, A. M. ;
Chang, K. ;
Lee, H. Y. .
INTERNATIONAL JOURNAL OF REMOTE SENSING, 2007, 28 (7-8) :1843-1856
[8]   Landslide detection by deep learning of non-nadiral and crowdsourced optical images [J].
Catani, Filippo .
LANDSLIDES, 2021, 18 (03) :1025-1044
[9]  
Chang C.-Y., 2020, P AS C COMP VIS
[10]   Symmetrical Dense-Shortcut Deep Fully Convolutional Networks for Semantic Segmentation of Very-High-Resolution Remote Sensing Images [J].
Chen, Guanzhou ;
Zhang, Xiaodong ;
Wang, Qing ;
Dai, Fan ;
Gong, Yuanfu ;
Zhu, Kun .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2018, 11 (05) :1633-1644