Self-Attention Fully Convolutional DenseNets for Automatic Salt Segmentation

被引:20
|
作者
Saad, Omar M. [1 ]
Chen, Wei [2 ,3 ]
Zhang, Fangxue [4 ]
Yang, Liuqing [5 ]
Zhou, Xu [6 ]
Chen, Yangkang [7 ]
机构
[1] Natl Res Inst Astron & Geophys NRIAG, Seismol Dept, ENSN Lab, Helwan 11421, Egypt
[2] Yangtze Univ, Cooperat Innovat Ctr Unconvent Oil & Gas, Minist Educ & Hubei Prov, Wuhan 430100, Peoples R China
[3] Yangtze Univ, Key Lab Explorat Technol Oil & Gas Resources, Minist Educ, Wuhan 430100, Peoples R China
[4] Zhejiang Univ, Sch Earth Sci, Key Lab Geosci Big Data & Deep Resource Zhejiang, Hangzhou 310027, Peoples R China
[5] China Univ Petr, State Key Lab Petr Resources & Prospecting, Beijing 102200, Peoples R China
[6] Louisiana State Univ, Craft & Hawkins Dept Petr Engn, Baton Rouge, LA 70803 USA
[7] Univ Texas Austin, Bur Econ Geol, University Stn, TX 78713 USA
基金
中国国家自然科学基金;
关键词
Feature extraction; Convolution; Data mining; Image segmentation; Convolutional neural networks; Geology; Training; Deep learning; salt segmentation; seismic interpretation; self-attention;
D O I
10.1109/TNNLS.2022.3175419
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
3-D salt segmentation is important for many research topics spanning from exploration geophysics to structural geology. In seismic exploration, 3-D salt segmentation is directly related to the velocity modeling building that affects many processing steps, such as seismic migration and full waveform inversion. Manually picking the salt boundary becomes prohibitively time-consuming when the data size is too large. Here, we develop a highly generalized fully convolutional DenseNet for automatic salt segmentation. A squeeze-and-excitation network is used as a self-attention mechanism for guiding the proposed network to extract the most significant information related to the salt signals and discard the others. The proposed framework is a supervised technique and shows robust performance when applied to a new dataset using transfer learning and a small amount of training data. We test the robustness of the proposed framework on the Kaggle TGS salt segmentation dataset. To demonstrate the generalization ability of the framework, we further apply the trained model to an independent dataset synthesized from the 3-D SEAM model. We apply transfer learning to finely tune the trained model from the TGS dataset using only a small percentage of data from the 3-D SEAM dataset and obtain satisfactory results.
引用
收藏
页码:3415 / 3428
页数:14
相关论文
共 50 条
  • [1] Fully Convolutional DenseNets for Polyp Segmentation in Colonoscopy
    Yu, Jieyao
    Pan, Haiwei
    Yin, Qi
    Bian, Xiaofei
    Cui, Qianna
    2019 IEEE 35TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING WORKSHOPS (ICDEW 2019), 2019, : 306 - 311
  • [2] Self-Attention Technology in Image Segmentation
    Cao, Fude
    Lu, Xueyun
    INTERNATIONAL CONFERENCE ON INTELLIGENT TRAFFIC SYSTEMS AND SMART CITY (ITSSC 2021), 2022, 12165
  • [3] Research of Self-Attention in Image Segmentation
    Cao, Fude
    Zheng, Chunguang
    Huang, Limin
    Wang, Aihua
    Zhang, Jiong
    Zhou, Feng
    Ju, Haoxue
    Guo, Haitao
    Du, Yuxia
    JOURNAL OF INFORMATION TECHNOLOGY RESEARCH, 2022, 15 (01)
  • [4] Deep Multiscale Convolutional Model With Multihead Self-Attention for Industrial Process Fault Diagnosis
    Chen, Youqiang
    Zhang, Ridong
    IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2025,
  • [5] Pyramid Self-attention for Semantic Segmentation
    Qi, Jiyang
    Wang, Xinggang
    Hu, Yao
    Tang, Xu
    Liu, Wenyu
    PATTERN RECOGNITION AND COMPUTER VISION, PT I, 2021, 13019 : 480 - 492
  • [6] ESAformer: Enhanced Self-Attention for Automatic Speech Recognition
    Li, Junhua
    Duan, Zhikui
    Li, Shiren
    Yu, Xinmei
    Yang, Guangguang
    IEEE SIGNAL PROCESSING LETTERS, 2024, 31 : 471 - 475
  • [7] Automatic Segmentation of Acute Ischemic Stroke From DWI Using 3-D Fully Convolutional DenseNets
    Zhang, Rongzhao
    Zhao, Lei
    Lou, Wutao
    Abrigo, Jill M.
    Mok, Vincent C. T.
    Chu, Winnie C. W.
    Wang, Defeng
    Shi, Lin
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2018, 37 (09) : 2149 - 2160
  • [8] Automatic Prostate Zonal Segmentation Using Fully Convolutional Network With Feature Pyramid Attention
    Liu, Yongkai
    Yang, Guang
    Afshari Mirak, Sohrab
    Hosseiny, Melina
    Azadikhah, Afshin
    Zhong, Xinran
    Reiter, Robert E.
    Lee, Yeejin
    Raman, Steven S.
    Sung, Kyunghyun
    IEEE ACCESS, 2019, 7 : 163626 - 163632
  • [9] 3D Thyroid Segmentation in CT Using Self-attention Convolutional Neural Network
    He, Xiuxiu
    Guo, Bang Jun
    Lei, Yang
    Liu, Yingzi
    Wang, Tonghe
    Curran, Walter J.
    Zhang, Long Jiang
    Liu, Tian
    Yang, Xiaofeng
    MEDICAL IMAGING 2020: COMPUTER-AIDED DIAGNOSIS, 2020, 11314
  • [10] COVID-19 lesion segmentation using convolutional LSTM for self-attention
    Killekar, Aditya
    Grodecki, Kajetan
    Lin, Andrew
    Cadet, Sebastien
    McElhinney, Priscilla
    Razipour, Aryabod
    Chan, Cato
    Pressman, Barry D.
    Julien, Peter
    Chen, Peter
    Simon, Judit
    Maurovich-Horvat, Pal
    Gaibazzi, Nicola
    Thakur, Udit
    Mancini, Elisabetta
    Agalbato, Cecilia
    Munechika, Jiro
    Matsumoto, Hidenari
    Mene, Roberto
    Parati, Gianfranco
    Cernigliaro, Franco
    Nerlekar, Nitesh
    Torlasco, Camilla
    Pontone, Gianluca
    Dey, Damini
    Slomka, Piotr J.
    MEDICAL IMAGING 2022: IMAGE PROCESSING, 2022, 12032