Self-Attention Fully Convolutional DenseNets for Automatic Salt Segmentation

被引:20
|
作者
Saad, Omar M. [1 ]
Chen, Wei [2 ,3 ]
Zhang, Fangxue [4 ]
Yang, Liuqing [5 ]
Zhou, Xu [6 ]
Chen, Yangkang [7 ]
机构
[1] Natl Res Inst Astron & Geophys NRIAG, Seismol Dept, ENSN Lab, Helwan 11421, Egypt
[2] Yangtze Univ, Cooperat Innovat Ctr Unconvent Oil & Gas, Minist Educ & Hubei Prov, Wuhan 430100, Peoples R China
[3] Yangtze Univ, Key Lab Explorat Technol Oil & Gas Resources, Minist Educ, Wuhan 430100, Peoples R China
[4] Zhejiang Univ, Sch Earth Sci, Key Lab Geosci Big Data & Deep Resource Zhejiang, Hangzhou 310027, Peoples R China
[5] China Univ Petr, State Key Lab Petr Resources & Prospecting, Beijing 102200, Peoples R China
[6] Louisiana State Univ, Craft & Hawkins Dept Petr Engn, Baton Rouge, LA 70803 USA
[7] Univ Texas Austin, Bur Econ Geol, University Stn, TX 78713 USA
基金
中国国家自然科学基金;
关键词
Feature extraction; Convolution; Data mining; Image segmentation; Convolutional neural networks; Geology; Training; Deep learning; salt segmentation; seismic interpretation; self-attention;
D O I
10.1109/TNNLS.2022.3175419
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
3-D salt segmentation is important for many research topics spanning from exploration geophysics to structural geology. In seismic exploration, 3-D salt segmentation is directly related to the velocity modeling building that affects many processing steps, such as seismic migration and full waveform inversion. Manually picking the salt boundary becomes prohibitively time-consuming when the data size is too large. Here, we develop a highly generalized fully convolutional DenseNet for automatic salt segmentation. A squeeze-and-excitation network is used as a self-attention mechanism for guiding the proposed network to extract the most significant information related to the salt signals and discard the others. The proposed framework is a supervised technique and shows robust performance when applied to a new dataset using transfer learning and a small amount of training data. We test the robustness of the proposed framework on the Kaggle TGS salt segmentation dataset. To demonstrate the generalization ability of the framework, we further apply the trained model to an independent dataset synthesized from the 3-D SEAM model. We apply transfer learning to finely tune the trained model from the TGS dataset using only a small percentage of data from the 3-D SEAM dataset and obtain satisfactory results.
引用
收藏
页码:3415 / 3428
页数:14
相关论文
共 50 条
  • [41] An Incipient Fault Diagnosis Method Based on Complex Convolutional Self-Attention Autoencoder for Analog Circuits
    Gao, Tianyu
    Yang, Jingli
    Jiang, Shouda
    Li, Ye
    IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2024, 71 (08) : 9727 - 9736
  • [42] MRSNet: Joint consistent optic disc and cup segmentation based on large kernel residual convolutional attention and self-attention
    Yan, Shiliang
    Pan, Xiaoqin
    Wang, Yinling
    DIGITAL SIGNAL PROCESSING, 2024, 145
  • [43] Deformable Self-Attention for Text Classification
    Ma, Qianli
    Yan, Jiangyue
    Lin, Zhenxi
    Yu, Liuhong
    Chen, Zipeng
    IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2021, 29 : 1570 - 1581
  • [44] Nonlocal convolutional block attention module VNet for gliomas automatic segmentation
    Fang, Ying
    Huang, He
    Yang, Weiji
    Xu, Xiaomei
    Jiang, Weiwei
    Lai, Xiaobo
    INTERNATIONAL JOURNAL OF IMAGING SYSTEMS AND TECHNOLOGY, 2022, 32 (02) : 528 - 543
  • [45] Weakly supervised histopathology image segmentation with self-attention
    Li, Kailu
    Qian, Ziniu
    Han, Yingnan
    Chang, Eric I-Chao
    Wei, Bingzheng
    Lai, Maode
    Liao, Jing
    Fan, Yubo
    Xu, Yan
    MEDICAL IMAGE ANALYSIS, 2023, 86
  • [46] FDSA-STG: Fully Dynamic Self-Attention Spatio-Temporal Graph Networks for Intelligent Traffic Flow Prediction
    Duan, Youxiang
    Chen, Ning
    Shen, Shigen
    Zhang, Peiying
    Qu, Youyang
    Yu, Shui
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2022, 71 (09) : 9250 - 9260
  • [47] Investigating Self-Attention Network for Chinese Word Segmentation
    Gan, Leilei
    Zhang, Yue
    IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2020, 28 : 2933 - 2941
  • [48] Weakly supervised action segmentation with effective use of attention and self-attention
    Bin Ng, Yan
    Fernando, Basura
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2021, 213
  • [49] Prior Attention Enhanced Convolutional Neural Network Based Automatic Segmentation of Organs at Risk for Head and Neck Cancer Radiotherapy
    Chen, Haibin
    Huang, Dongyun
    Lin, Li
    Qi, Zhenyu
    Xie, Peiliang
    Wei, Jun
    Chang, Lin
    Sun, Ying
    Wu, Dongmei
    Lu, Yao
    IEEE ACCESS, 2020, 8 : 179018 - 179027
  • [50] A Self-Attention Feature Fusion Model for Rice Pest Detection
    Li, Shuaifeng
    Wang, Heng
    Zhang, Cong
    Liu, Jie
    IEEE ACCESS, 2022, 10 : 84063 - 84077