Self-Attention Fully Convolutional DenseNets for Automatic Salt Segmentation

被引:20
|
作者
Saad, Omar M. [1 ]
Chen, Wei [2 ,3 ]
Zhang, Fangxue [4 ]
Yang, Liuqing [5 ]
Zhou, Xu [6 ]
Chen, Yangkang [7 ]
机构
[1] Natl Res Inst Astron & Geophys NRIAG, Seismol Dept, ENSN Lab, Helwan 11421, Egypt
[2] Yangtze Univ, Cooperat Innovat Ctr Unconvent Oil & Gas, Minist Educ & Hubei Prov, Wuhan 430100, Peoples R China
[3] Yangtze Univ, Key Lab Explorat Technol Oil & Gas Resources, Minist Educ, Wuhan 430100, Peoples R China
[4] Zhejiang Univ, Sch Earth Sci, Key Lab Geosci Big Data & Deep Resource Zhejiang, Hangzhou 310027, Peoples R China
[5] China Univ Petr, State Key Lab Petr Resources & Prospecting, Beijing 102200, Peoples R China
[6] Louisiana State Univ, Craft & Hawkins Dept Petr Engn, Baton Rouge, LA 70803 USA
[7] Univ Texas Austin, Bur Econ Geol, University Stn, TX 78713 USA
基金
中国国家自然科学基金;
关键词
Feature extraction; Convolution; Data mining; Image segmentation; Convolutional neural networks; Geology; Training; Deep learning; salt segmentation; seismic interpretation; self-attention;
D O I
10.1109/TNNLS.2022.3175419
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
3-D salt segmentation is important for many research topics spanning from exploration geophysics to structural geology. In seismic exploration, 3-D salt segmentation is directly related to the velocity modeling building that affects many processing steps, such as seismic migration and full waveform inversion. Manually picking the salt boundary becomes prohibitively time-consuming when the data size is too large. Here, we develop a highly generalized fully convolutional DenseNet for automatic salt segmentation. A squeeze-and-excitation network is used as a self-attention mechanism for guiding the proposed network to extract the most significant information related to the salt signals and discard the others. The proposed framework is a supervised technique and shows robust performance when applied to a new dataset using transfer learning and a small amount of training data. We test the robustness of the proposed framework on the Kaggle TGS salt segmentation dataset. To demonstrate the generalization ability of the framework, we further apply the trained model to an independent dataset synthesized from the 3-D SEAM model. We apply transfer learning to finely tune the trained model from the TGS dataset using only a small percentage of data from the 3-D SEAM dataset and obtain satisfactory results.
引用
收藏
页码:3415 / 3428
页数:14
相关论文
共 50 条
  • [41] Progressive Scene Segmentation Based on Self-Attention Mechanism
    Pan, Yunyi
    Gan, Yuan
    Liu, Kun
    Zhang, Yan
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 3985 - 3992
  • [42] Investigating Self-Attention Network for Chinese Word Segmentation
    Gan, Leilei
    Zhang, Yue
    IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2020, 28 : 2933 - 2941
  • [43] Weakly supervised action segmentation with effective use of attention and self-attention
    Bin Ng, Yan
    Fernando, Basura
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2021, 213
  • [44] Automatic segmentation of golden pomfret based on fusion of multi-head self-attention and channel-attention mechanism
    Yu, Guoyan
    Luo, Yingtong
    Deng, Ruoling
    COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2022, 202
  • [45] ON THE USEFULNESS OF SELF-ATTENTION FOR AUTOMATIC SPEECH RECOGNITION WITH TRANSFORMERS
    Zhang, Shucong
    Loweimi, Erfan
    Bell, Peter
    Renals, Steve
    2021 IEEE SPOKEN LANGUAGE TECHNOLOGY WORKSHOP (SLT), 2021, : 89 - 96
  • [46] ESAformer: Enhanced Self-Attention for Automatic Speech Recognition
    Li, Junhua
    Duan, Zhikui
    Li, Shiren
    Yu, Xinmei
    Yang, Guangguang
    IEEE SIGNAL PROCESSING LETTERS, 2024, 31 : 471 - 475
  • [47] Text Detection in Natural Scenes using Fully Convolutional DenseNets
    Behzadi, Mitra
    Safabakhsh, Reza
    2018 4TH IRANIAN CONFERENCE ON SIGNAL PROCESSING AND INTELLIGENT SYSTEMS (ICSPIS), 2018, : 11 - 14
  • [48] Efficient Semantic Segmentation via Self-Attention and Self-Distillation
    An, Shumin
    Liao, Qingmin
    Lu, Zongqing
    Xue, Jing-Hao
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (09) : 15256 - 15266
  • [49] Self-Attention Based Sequential Recommendation With Graph Convolutional Networks
    Seng, Dewen
    Wang, Jingchang
    Zhang, Xuefeng
    IEEE ACCESS, 2024, 12 : 32780 - 32787
  • [50] Convolutional LSTM with Self-Attention Mechanism for Extreme Weather Prediction
    Zou, Wenxin
    Ji, Junzhong
    Wang, Yutong
    Wang, Jiayi
    Qian, Yutong
    Liu, Jinduo
    Proceedings - 2023 China Automation Congress, CAC 2023, 2023, : 6782 - 6787