Automatic Detection of Coseismic Landslides Using a New Transformer Method

被引:60
|
作者
Tang, Xiaochuan [1 ,2 ,3 ]
Tu, Zihan [2 ]
Wang, Yu [2 ]
Liu, Mingzhe [1 ,2 ]
Li, Dongfen [2 ]
Fan, Xuanmei [1 ]
机构
[1] Chengdu Univ Technol, State Key Lab Geohazard Prevent & Geoenvironm Pro, Chengdu 610059, Peoples R China
[2] Chengdu Univ Technol, Coll Comp & Cyber Secur, Chengdu 610059, Peoples R China
[3] Univ Elect Sci & Technol China, Natl Lab Sci & Technol Commun, Chengdu 611731, Peoples R China
基金
中国博士后科学基金; 中国国家自然科学基金;
关键词
landslide detection; coseismic landslide; Transformer; self-attention; convolutional neural network; semantic segmentation; deep learning; ALGORITHM; NETWORK; FOREST; LIDAR;
D O I
10.3390/rs14122884
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Earthquake-triggered landslides frequently occur in active mountain areas, which poses great threats to the safety of human lives and public infrastructures. Fast and accurate mapping of coseismic landslides is important for earthquake disaster emergency rescue and landslide risk analysis. Machine learning methods provide automatic solutions for landslide detection, which are more efficient than manual landslide mapping. Deep learning technologies are attracting increasing interest in automatic landslide detection. CNN is one of the most widely used deep learning frameworks for landslide detection. However, in practice, the performance of the existing CNN-based landslide detection models is still far from practical application. Recently, Transformer has achieved better performance in many computer vision tasks, which provides a great opportunity for improving the accuracy of landslide detection. To fill this gap, we explore whether Transformer can outperform CNNs in the landslide detection task. Specifically, we build a new dataset for identifying coseismic landslides. The Transformer-based semantic segmentation model SegFormer is employed to identify coseismic landslides. SegFormer leverages Transformer to obtain a large receptive field, which is much larger than CNN. SegFormer introduces overlapped patch embedding to capture the interaction of adjacent image patches. SegFormer also introduces a simple MLP decoder and sequence reduction to improve its efficiency. The semantic segmentation results of SegFormer are further improved by leveraging image processing operations to distinguish different landslide instances and remove invalid holes. Extensive experiments have been conducted to compare Transformer-based model SegFormer with other popular CNN-based models, including HRNet, DeepLabV3, Attention-UNet, U2Net and FastSCNN. SegFormer improves the accuracy, mIoU, IoU and F1 score of landslide detectuin by 2.2%, 5% and 3%, respectively. SegFormer also reduces the pixel-wise classification error rate by 14%. Both quantitative evaluation and visualization results show that Transformer is capable of outperforming CNNs in landslide detection.
引用
收藏
页数:19
相关论文
共 50 条
  • [21] Semi-supervised automatic dental age and sex estimation using a hybrid transformer model
    Fan, Fei
    Ke, Wenchi
    Dai, Xinhua
    Shi, Lei
    Liu, Yuanyuan
    Lin, Yushan
    Cheng, Ziqi
    Zhang, Yi
    Chen, Hu
    Deng, Zhenhua
    INTERNATIONAL JOURNAL OF LEGAL MEDICINE, 2023, 137 (03) : 721 - 731
  • [22] A New Segmentation Method for Rotational Landslide Detection Using Outlier Detection
    Celik, Cahit Tagi
    TEHNICKI VJESNIK-TECHNICAL GAZETTE, 2019, 26 (01): : 43 - 48
  • [23] Semi-supervised automatic dental age and sex estimation using a hybrid transformer model
    Fei Fan
    Wenchi Ke
    Xinhua Dai
    Lei Shi
    Yuanyuan Liu
    Yushan Lin
    Ziqi Cheng
    Yi Zhang
    Hu Chen
    Zhenhua Deng
    International Journal of Legal Medicine, 2023, 137 : 721 - 731
  • [24] Detecting Coseismic Landslides in GEE Using Machine Learning Algorithms on Combined Optical and Radar Imagery
    Peters, Stefan
    Liu, Jixue
    Keppel, Gunnar
    Wendleder, Anna
    Xu, Peiliang
    REMOTE SENSING, 2024, 16 (10)
  • [25] A Method for Automatic Lane Detection using a Deep Network
    Fallah, A. A.
    Soleymani, A.
    Khosravi, H.
    INTERNATIONAL JOURNAL OF ENGINEERING, 2022, 35 (04): : 802 - 809
  • [26] Improving small objects detection using transformer
    Dubey, Shikha
    Olimov, Farrukh
    Rafique, Muhammad Aasim
    Jeon, Moongu
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2022, 89
  • [27] Quick and automatic detection of co-seismic landslides with multi-feature deep learning model
    Huangfu, Wenchao
    Qiu, Haijun
    Cui, Peng
    Yang, Dongdong
    Liu, Ya
    Tang, Bingzhe
    Liu, Zijing
    Ullah, Mohib
    SCIENCE CHINA-EARTH SCIENCES, 2024, 67 (07) : 2311 - 2325
  • [28] Automatic Mapping of Potential Landslides Using Satellite Multitemporal Interferometry
    Zhang, Yi
    Li, Yuanxi
    Meng, Xingmin
    Liu, Wangcai
    Wang, Aijie
    Liang, Yiwen
    Su, Xiaojun
    Zeng, Runqiang
    Chen, Xu
    REMOTE SENSING, 2023, 15 (20)
  • [29] Automatic License Plate Recognition Using Transformer
    Zhang, Teng
    Jia, Wei
    FOURTEENTH INTERNATIONAL CONFERENCE ON GRAPHICS AND IMAGE PROCESSING, ICGIP 2022, 2022, 12705
  • [30] Multiscale fire image detection method based on CNN and Transformer
    Shengbao Wu
    Buyun Sheng
    Gaocai Fu
    Daode Zhang
    Yuchao Jian
    Multimedia Tools and Applications, 2024, 83 : 49787 - 49811