Swin Transformer-Based Multiscale Attention Model for Landslide Extraction From Large-Scale Area

被引:0
|
作者
Gao, Mengjie [1 ,2 ]
Chen, Fang [1 ,2 ]
Wang, Lei [1 ,2 ]
Zhao, Huichen [3 ]
Yu, Bo [1 ,2 ]
机构
[1] Chinese Acad Sci, Aerosp Informat Res Inst, Key Lab Digital Earth Sci, Beijing 100094, Peoples R China
[2] Chinese Acad Sci, Int Res Ctr Big Data Sustainable Dev Goals, Beijing 100094, Peoples R China
[3] Chinese Acad Sci, Inst Atmospher Phys, Beijing 100029, Peoples R China
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2024年 / 62卷
关键词
Terrain factors; Feature extraction; Transformers; Disasters; Data mining; Remote sensing; Geology; Earthquakes; Earth; Accuracy; Candidate landslides; large-scale landslide extraction; multiscale landslides; Swin Transformer-based multiscale attention model (Swin-MA); TIME-SERIES; IMAGE; LIDAR; CLASSIFICATION; REGRESSION; DATASET;
D O I
10.1109/TGRS.2024.3477910
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Landslides, a frequent and devastating natural disaster, pose significant risks to human populations and the environment, often leading to substantial loss of life, property damage, and ecological disruption. Creating a comprehensive landslide inventory is essential for disaster response planning and understanding landslide mechanisms. Current methods for landslide extraction, often designed for specific events and primarily focused on vegetative backgrounds, face challenges in practical applications. Landslide extraction from large-scale areas encounters two primary challenges: data imbalance between landslides and background objects and the confusing features of small-scale landslides with complex background objects. This article introduces a two-phase framework for extracting multiscale landslides across large areas with intricate backgrounds. Initially, a dual-temporal image-based method is employed to identify candidate landslides, effectively reducing background interference and addressing data imbalance. Subsequently, a Swin Transformer-based multiscale attention model (Swin-MA) is proposed to capture and learn multiscale landslide features comprehensively. We conducted our study in two regions: the Hengduan Mountains in China, a hotspot for frequent landslides, and Hokkaido, Japan, where significant landslides occurred following an earthquake on September 6, 2018. Our approach outperforms seven recently proposed methods, demonstrating at least a 5.36% improvement in intersection over union (IoU) and affirming its effectiveness and significance in large-scale landslide extraction.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] A Swin Transformer-based model for mosquito species identification
    Zhao, De-zhong
    Wang, Xin-kai
    Zhao, Teng
    Li, Hu
    Xing, Dan
    Gao, He-ting
    Song, Fan
    Chen, Guo-hua
    Li, Chun-xiao
    SCIENTIFIC REPORTS, 2022, 12 (01)
  • [2] A Swin Transformer-based model for mosquito species identification
    De-zhong Zhao
    Xin-kai Wang
    Teng Zhao
    Hu Li
    Dan Xing
    He-ting Gao
    Fan Song
    Guo-hua Chen
    Chun-xiao Li
    Scientific Reports, 12
  • [3] Large-scale landslide in kostanjek area
    Stanic, Bogdan
    Nonveiller, Ervin
    Gradevinar, 1995, 47 (04):
  • [4] An Architecture for Accelerated Large-Scale Inference of Transformer-Based Language Models
    Ganiev, Amir
    Chapin, Colt
    de Andrade, Anderson
    Liu, Chen
    2021 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, NAACL-HLT 2021, 2021, : 163 - 169
  • [5] Compressing Large-Scale Transformer-Based Models: A Case Study on BERT
    Ganesh, Prakhar
    Chen, Yao
    Lou, Xin
    Khan, Mohammad Ali
    Yang, Yin
    Sajjad, Hassan
    Nakov, Preslav
    Chen, Deming
    Winslett, Marianne
    TRANSACTIONS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, 2021, 9 : 1061 - 1080
  • [6] Deep convolutional neural networks and Swin transformer-based frameworks for individual date palm tree detection and mapping from large-scale UAV images
    Gibril, Mohamed Barakat A.
    Shafri, Helmi Zulhaidi Mohd
    Shanableh, Abdallah
    Al-Ruzouq, Rami
    Wayayok, Aimrun
    bin Hashim, Shaiful Jahari
    Sachit, Mourtadha Sarhan
    GEOCARTO INTERNATIONAL, 2022, 37 (27) : 18569 - 18599
  • [7] Transformer-based semantic segmentation for large-scale building footprint extraction from very-high resolution satellite images
    Gibril, Mohamed Barakat A.
    Al-Ruzouq, Rami
    Shanableh, Abdallah
    Jena, Ratiranjan
    Bolcek, Jan
    Shafri, Helmi Zulhaidi Mohd
    Ghorbanzadeh, Omid
    ADVANCES IN SPACE RESEARCH, 2024, 73 (10) : 4937 - 4954
  • [8] Road Extraction from Remote Sensing Imagery with Spatial Attention Based on Swin Transformer
    Zhu, Xianhong
    Huang, Xiaohui
    Cao, Weijia
    Yang, Xiaofei
    Zhou, Yunfei
    Wang, Shaokai
    REMOTE SENSING, 2024, 16 (07)
  • [9] Transformer-based biomarker prediction from colorectal cancer histology: A large-scale multicentric study
    Wagner, Sophia J.
    Reisenbuechler, Daniel
    West, Nicholas P.
    Niehues, Jan Moritz
    Zhu, Jiefu
    Foersch, Sebastian
    Veldhuizen, Gregory Patrick
    Quirke, Philip
    Grabsch, Heike I.
    van den Brandt, Piet A.
    Hutchins, Gordon G. A.
    Richman, Susan D.
    Yuan, Tanwei
    Langer, Rupert
    Jenniskens, Josien C. A.
    Offermans, Kelly
    Mueller, Wolfram
    Gray, Richard
    Gruber, Stephen B.
    Greenson, Joel K.
    Rennert, Gad
    Bonner, Joseph D.
    Schmolze, Daniel
    Jonnagaddala, Jitendra
    Hawkins, Nicholas J.
    Ward, Robyn L.
    Morton, Dion
    Seymour, Matthew
    Magill, Laura
    Nowak, Marta
    Hay, Jennifer
    Koelzer, Viktor H.
    Church, David N.
    Matek, Christian
    Geppert, Carol
    Peng, Chaolong
    Zhi, Cheng
    Ouyang, Xiaoming
    James, Jacqueline A.
    Loughrey, Maurice B.
    Salto-Tellez, Manuel
    Brenner, Hermann
    Hoffmeister, Michael
    Truhn, Daniel
    Schnabel, Julia A.
    Boxberg, Melanie
    Peng, Tingying
    Kather, Jakob Nikolas
    CANCER CELL, 2023, 41 (09) : 1650 - +
  • [10] MCTNet: Multiscale Cross-Attention-Based Transformer Network for Semantic Segmentation of Large-Scale Point Cloud
    Guo, Bo
    Deng, Liwei
    Wang, Ruisheng
    Guo, Wenchao
    Ng, Alex Hay-Man
    Bai, Wenfeng
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61