Automatic Detection of Coseismic Landslides Using a New Transformer Method

被引:60
|
作者
Tang, Xiaochuan [1 ,2 ,3 ]
Tu, Zihan [2 ]
Wang, Yu [2 ]
Liu, Mingzhe [1 ,2 ]
Li, Dongfen [2 ]
Fan, Xuanmei [1 ]
机构
[1] Chengdu Univ Technol, State Key Lab Geohazard Prevent & Geoenvironm Pro, Chengdu 610059, Peoples R China
[2] Chengdu Univ Technol, Coll Comp & Cyber Secur, Chengdu 610059, Peoples R China
[3] Univ Elect Sci & Technol China, Natl Lab Sci & Technol Commun, Chengdu 611731, Peoples R China
基金
中国博士后科学基金; 中国国家自然科学基金;
关键词
landslide detection; coseismic landslide; Transformer; self-attention; convolutional neural network; semantic segmentation; deep learning; ALGORITHM; NETWORK; FOREST; LIDAR;
D O I
10.3390/rs14122884
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Earthquake-triggered landslides frequently occur in active mountain areas, which poses great threats to the safety of human lives and public infrastructures. Fast and accurate mapping of coseismic landslides is important for earthquake disaster emergency rescue and landslide risk analysis. Machine learning methods provide automatic solutions for landslide detection, which are more efficient than manual landslide mapping. Deep learning technologies are attracting increasing interest in automatic landslide detection. CNN is one of the most widely used deep learning frameworks for landslide detection. However, in practice, the performance of the existing CNN-based landslide detection models is still far from practical application. Recently, Transformer has achieved better performance in many computer vision tasks, which provides a great opportunity for improving the accuracy of landslide detection. To fill this gap, we explore whether Transformer can outperform CNNs in the landslide detection task. Specifically, we build a new dataset for identifying coseismic landslides. The Transformer-based semantic segmentation model SegFormer is employed to identify coseismic landslides. SegFormer leverages Transformer to obtain a large receptive field, which is much larger than CNN. SegFormer introduces overlapped patch embedding to capture the interaction of adjacent image patches. SegFormer also introduces a simple MLP decoder and sequence reduction to improve its efficiency. The semantic segmentation results of SegFormer are further improved by leveraging image processing operations to distinguish different landslide instances and remove invalid holes. Extensive experiments have been conducted to compare Transformer-based model SegFormer with other popular CNN-based models, including HRNet, DeepLabV3, Attention-UNet, U2Net and FastSCNN. SegFormer improves the accuracy, mIoU, IoU and F1 score of landslide detectuin by 2.2%, 5% and 3%, respectively. SegFormer also reduces the pixel-wise classification error rate by 14%. Both quantitative evaluation and visualization results show that Transformer is capable of outperforming CNNs in landslide detection.
引用
收藏
页数:19
相关论文
共 50 条
  • [31] Automatic crack detection method for high-speed railway box girder based on deep learning techniques and inspection robot
    Guo, Wei
    Liang, Guangyue
    Ren, Shaoxun
    Zeng, Chen
    STRUCTURES, 2024, 68
  • [32] Multiscale fire image detection method based on CNN and Transformer
    Wu, Shengbao
    Sheng, Buyun
    Fu, Gaocai
    Zhang, Daode
    Jian, Yuchao
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 83 (16) : 49787 - 49811
  • [33] A new comprehensive automatic fault detection method for rotating machinery using HmvAAPE and VNWOA-KELM
    Gong, Jiancheng
    Yang, Xiaoqiang
    Han, Jun
    Shen, Jinxing
    Zhou, Fuming
    Liu, Wuqiang
    APPLIED INTELLIGENCE, 2023, 53 (01) : 204 - 225
  • [34] ODFormer: Semantic fundus image segmentation using Transformer for optic nerve head detection
    Wang, Jiayi
    Mao, Yi-An
    Ma, Xiaoyu
    Guo, Sicen
    Shao, Yuting
    Lv, Xiao
    Han, Wenting
    Christopher, Mark
    Zangwill, Linda M.
    Bi, Yanlong
    Fan, Rui
    INFORMATION FUSION, 2024, 112
  • [35] Explainable Detection of Microplastics Using Transformer Neural Networks
    Barker, Max
    Willans, Meg
    Pham, Duc-Son
    Krishna, Aneesh
    Hackett, Mark
    AI 2022: ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, 13728 : 102 - 115
  • [36] MobileRaT: A Lightweight Radio Transformer Method for Automatic Modulation Classification in Drone Communication Systems
    Zheng, Qinghe
    Tian, Xinyu
    Yu, Zhiguo
    Ding, Yao
    Elhanashi, Abdussalam
    Saponara, Sergio
    Kpalma, Kidiyo
    DRONES, 2023, 7 (10)
  • [37] A comprehensive review on automatic hate speech detection in the age of the transformer
    Ramos, Gil
    Batista, Fernando
    Ribeiro, Ricardo
    Fialho, Pedro
    Moro, Sergio
    Fonseca, Antonio
    Guerra, Rita
    Carvalho, Paula
    Marques, Catarina
    Silva, Claudia
    SOCIAL NETWORK ANALYSIS AND MINING, 2024, 14 (01)
  • [38] Text-conditioned Transformer for automatic pronunciation error detection
    Zhang, Zhan
    Wang, Yuehai
    Yang, Jianyi
    SPEECH COMMUNICATION, 2021, 130 (130) : 55 - 63
  • [39] Automatic Feature Learning Method for Detection of Retinal Landmarks
    Al-Bander, Baidaa
    Al-Nuaimy, Waleed
    Al-Taee, Majid A.
    Al-Ataby, Ali
    Zheng, Yalin
    2016 9TH INTERNATIONAL CONFERENCE ON DEVELOPMENTS IN ESYSTEMS ENGINEERING (DESE 2016), 2016, : 13 - 18
  • [40] Automatic Detection of Transformer Health Based on Bayesian Network Model
    He, Yingfeng
    Pang, Yanan
    APPLIED MATHEMATICS AND NONLINEAR SCIENCES, 2023,