Enhanced Lithology Classification Using an Interpretable SHAP Model Integrating Semi-Supervised Contrastive Learning and Transformer with Well Logging Data

被引:0
|
作者
Sun, Youzhuang [1 ,2 ]
Pang, Shanchen [1 ,2 ]
Li, Hengxiao [1 ,2 ]
Qiao, Sibo [3 ]
Zhang, Yongan [1 ,2 ]
机构
[1] China Univ Petr East China, Coll Comp Sci, Qingdao, Shandong, Peoples R China
[2] China Univ Petr East China, Qingdao Coll Software, Qingdao, Shandong, Peoples R China
[3] Tiangong Univ, Coll Software, Tianjin, Peoples R China
关键词
Lithology prediction; Logging parameters; Machine learning; Transformer; Contrastive learning;
D O I
10.1007/s11053-024-10452-z
中图分类号
P [天文学、地球科学];
学科分类号
07 ;
摘要
In petroleum and natural gas exploration, lithology identification-analyzing rock types beneath the Earth's surface-is crucial for assessing hydrocarbon reservoirs and optimizing drilling strategies. Traditionally, this process relies on logging data such as gamma rays and resistivity, which often require manual interpretation, making it labor-intensive and prone to errors. To address these challenges, we propose a novel machine learning framework-contrastive learning-transformer-leveraging self-attention mechanisms to enhance the accuracy of lithology identification. Our method first extracts unlabeled samples from logging data while obtaining labeled core sample data. Through self-supervised contrastive learning and a transformer backbone network, we optimize performance using techniques like batch normalization. After pretraining, the model is fine-tuned with a limited number of labeled samples to improve accuracy and significantly reduce reliance on large labeled datasets, thereby lowering the costs associated with drilling core annotations. Additionally, our research incorporates shapley additive explanations (SHAP) technology to enhance the transparency of the model's decision-making process, facilitating the analysis of the contribution of each feature to lithology predictions. The model also learns time-reversal invariance by reversing sequential data, ensuring reliable identification even with variations in data sequences. Experimental results demonstrate that our transformer model, combined with semi-supervised contrastive learning, significantly outperforms traditional methods, achieving more precise lithology identification, especially in complex geological environments.
引用
收藏
页码:785 / 813
页数:29
相关论文
共 50 条
  • [31] Classification Model on Big Data in Medical Diagnosis Based on Semi-Supervised Learning
    Wang, Lei
    Qian, Qing
    Zhang, Qiang
    Wang, Jishuai
    Cheng, Wenbo
    Yan, Wei
    COMPUTER JOURNAL, 2022, 65 (02): : 177 - 191
  • [32] LANDSLIDE IMAGE CLASSIFICATION USING SEMI-SUPERVISED LEARNING
    He, Shi
    Jing, Haitao
    Tang, Hong
    Shen, Li
    Tao, Liangliang
    Cheng, Jiehai
    2019 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2019), 2019, : 2643 - 2645
  • [33] An Aggregate Learning Approach for Interpretable Semi-supervised Population Prediction and Disaggregation Using Ancillary Data
    Derval, Guillaume
    Docquier, Frederic
    Schaus, Pierre
    MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, ECML PKDD 2019, PT III, 2020, 11908 : 672 - 687
  • [34] Innovative lithology identification enhancement via the recurrent transformer model with well logging data
    Sun, Youzhuang
    Pang, Shanchen
    Zhang, Yongan
    GEOENERGY SCIENCE AND ENGINEERING, 2024, 240
  • [35] Semi-supervised learning for lithology identification using Laplacian support vector machine
    Li, Zerui
    Kang, Yu
    Feng, Deyong
    Wang, Xing-Mou
    Lv, Wenjun
    Chang, Ji
    Zheng, Wei Xing
    JOURNAL OF PETROLEUM SCIENCE AND ENGINEERING, 2020, 195
  • [36] Semi-supervised learning for medical image classification using imbalanced training data
    Huynh, Tri
    Nibali, Aiden
    He, Zhen
    COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE, 2022, 216
  • [37] Semi-supervised Learning for Sentiment Classification using Small Number of Labeled Data
    Lee, Vivian Lay Shan
    Gan, Keng Hoon
    Tan, Tien Ping
    Abdullah, Rosni
    FIFTH INFORMATION SYSTEMS INTERNATIONAL CONFERENCE, 2019, 161 : 577 - 584
  • [38] Semi-supervised learning for medical image classification using imbalanced training data
    Huynh, Tri
    Nibali, Aiden
    He, Zhen
    Computer Methods and Programs in Biomedicine, 2022, 216
  • [39] Semi-Supervised Machine Learning for Livestock Threat Classification Using GPS Data
    De Swardt, Urs J.
    Kamper, Herman
    IEEE ACCESS, 2023, 11 : 27749 - 27758
  • [40] Deep semi-supervised learning with contrastive learning and partial label propagation for image data
    Gan, Yanglan
    Zhu, Huichun
    Guo, Wenjing
    Xu, Guangwei
    Zou, Guobing
    KNOWLEDGE-BASED SYSTEMS, 2022, 245