Landslide Detection Based on ResU-Net with Transformer and CBAM Embedded: Two Examples with Geologically Different Environments

被引:61
作者
Yang, Zhiqiang [1 ,2 ]
Xu, Chong [1 ,2 ]
Li, Lei [1 ,2 ,3 ]
机构
[1] Minist Emergency Management, Natl Inst Nat Hazards, Beijing 100085, Peoples R China
[2] Minist Emergency Management China, Key Lab Compound & Chained Nat Hazards Dynam, Beijing 100085, Peoples R China
[3] China Univ Geosci Beijing, Sch Engn & Technol, Beijing 100083, Peoples R China
关键词
landslide detection; deep learning; transformer; ResU-Net; CBAM; self-attention; RECOGNITION; EARTHQUAKE;
D O I
10.3390/rs14122885
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
An efficient method of landslide detection can provide basic scientific data for emergency command and landslide susceptibility mapping. Compared to a traditional landslide detection approach, convolutional neural networks (CNN) have been proven to have powerful capabilities in reducing the time consumed for selecting the appropriate features for landslides. Currently, the success of transformers in natural language processing (NLP) demonstrates the strength of self-attention in global semantic information acquisition. How to effectively integrate transformers into CNN, alleviate the limitation of the receptive field, and improve the model generation are hot topics in remote sensing image processing based on deep learning (DL). Inspired by the vision transformer (ViT), this paper first attempts to integrate a transformer into ResU-Net for landslide detection tasks with small datasets, aiming to enhance the network ability in modelling the global context of feature maps and drive the model to recognize landslides with a small dataset. Besides, a spatial and channel attention module was introduced into the decoder to effectually suppress the noise in the feature maps from the convolution and transformer. By selecting two landslide datasets with different geological characteristics, the feasibility of the proposed model was validated. Finally, the standard ResU-Net was chosen as the benchmark to evaluate the proposed model rationality. The results indicated that the proposed model obtained the highest mIoU and F1-score in both datasets, demonstrating that the ResU-Net with a transformer embedded can be used as a robust landslide detection method and thus realize the generation of accurate regional landslide inventory and emergency rescue.
引用
收藏
页数:19
相关论文
共 73 条
[1]   Improving Spatial Agreement in Machine Learning-Based Landslide Susceptibility Mapping [J].
Adnan, Mohammed Sarfaraz Gani ;
Rahman, Md Salman ;
Ahmed, Nahian ;
Ahmed, Bayes ;
Rabbi, Md. Fazleh ;
Rahman, Rashedur M. .
REMOTE SENSING, 2020, 12 (20) :1-23
[2]   Review of deep learning: concepts, CNN architectures, challenges, applications, future directions [J].
Alzubaidi, Laith ;
Zhang, Jinglan ;
Humaidi, Amjad J. ;
Al-Dujaili, Ayad ;
Duan, Ye ;
Al-Shamma, Omran ;
Santamaria, J. ;
Fadhel, Mohammed A. ;
Al-Amidie, Muthana ;
Farhan, Laith .
JOURNAL OF BIG DATA, 2021, 8 (01)
[3]  
[Anonymous], 2017, Advances in Neural Information Processing Systems
[4]  
[Anonymous], 1984, Bulletin of the Association of Engineering Geologists, DOI DOI 10.2113/GSEEGEOSCI.XXI.3.337
[5]   Vision Transformers for Remote Sensing Image Classification [J].
Bazi, Yakoub ;
Bashmal, Laila ;
Rahhal, Mohamad M. Al ;
Dayil, Reham Al ;
Ajlan, Naif Al .
REMOTE SENSING, 2021, 13 (03) :1-20
[6]   How far are we from the use of satellite rainfall products in landslide forecasting? [J].
Brunetti, M. T. ;
Melillo, M. ;
Peruccacci, S. ;
Ciabatta, L. ;
Brocca, L. .
REMOTE SENSING OF ENVIRONMENT, 2018, 210 :65-75
[7]   Landslide Detection Using Densely Connected Convolutional Networks and Environmental Conditions [J].
Cai, Haojie ;
Chen, Tao ;
Niu, Ruiqing ;
Plaza, Antonio .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2021, 14 :5235-5247
[8]  
Chen J., 2021, ArXiv, DOI [DOI 10.1038/S41592-020-01008-Z, DOI 10.1038/s41566-021-00828-5]
[9]  
Chen X., 2022, arXiv
[10]  
Davis J., 2006, P 23 INT C MACH LEAR, P233, DOI DOI 10.1145/1143844.1143874