Real-time prediction of logging parameters during the drilling process using an attention-based Seq2Seq model

被引:10
作者
Zhang, Rui [1 ]
Zhang, Chengkai [2 ]
Song, Xianzhi [2 ]
Li, Zukui [3 ]
Su, Yinao [4 ]
Li, Gensheng [2 ]
Zhu, Zhaopeng [2 ]
机构
[1] China Univ Petr, Coll Artificial Intelligence, Beijing 102249, Peoples R China
[2] China Univ Petr, Coll Petr Engn, Beijing 102249, Peoples R China
[3] Univ Alberta, Dept Chem & Mat Engn, Edmonton, AB T6G 1H9, Canada
[4] CNPC Engn Technol R&D Co Ltd, Beijing 102206, Peoples R China
来源
GEOENERGY SCIENCE AND ENGINEERING | 2024年 / 233卷
关键词
Logging parameter; Real-time prediction; Multi-step forecasting; Deep learning; Seq2Seq; Attention mechanism; EXPERIENCE;
D O I
10.1016/j.geoen.2023.212279
中图分类号
TE [石油、天然气工业]; TK [能源与动力工程];
学科分类号
0807 ; 0820 ;
摘要
In recent years, there has been a notable upsurge within the drilling industry regarding the construction of machine learning models that leverage logging parameters to augment decision-making processes. When building these models, the logging parameters are usually assumed to be fully accessible. However, it may not always hold true because certain logging parameters will be inaccessible or unavailable in real-time drilling operations, which greatly hinders the practical implementation of these models. Aiming at addressing the logging parameters' accessibility issue, this paper proposes an innovative attention-based sequence-to-sequence (Seq2-Seq) model to enable real-time predictions. The proposed model integrates the Seq2Seq model, bidirectional Gated Recurrent Unit (GRU) model, and attention mechanism to enable multi-step ahead prediction. Further-more, dynamic updates using the sliding window method with intermittent frequency are employed to enhance the model's performance. Meanwhile, hyperparameter tuning is automatically performed using an open-source toolbox to boost the model training process. Finally, the efficacy of the model is evaluated by predicting four commonly utilized logging parameters (surface torque, standpipe pressure, mud pit volume, and Gamma ray) based on two field drilling datasets. The comprehensive analysis demonstrates promising results, with mean absolute percentage errors below 5% across the datasets. Moreover, the attention-based Seq2Seq model surpasses base models (the vanilla GRU model and the Seq2Seq model) due to the inherent Seq2Seq structure, bidirectional architecture, and attention layer. This paper offers a practical approach to bridge the gap between the devel-opment of theoretical machine learning models and their implementation in real-world drilling processes.
引用
收藏
页数:13
相关论文
共 60 条
  • [1] Comparative analysis of artificial intelligence techniques for formation pressure prediction while drilling
    Ahmed, Abdulmalek
    Elkatatny, Salaheldin
    Ali, Abdulwahab
    Abdulraheem, Abdulazeez
    [J]. ARABIAN JOURNAL OF GEOSCIENCES, 2019, 12 (18)
  • [2] Ahmed O.S., 2019, ABU DHABI INT PETROL
  • [3] Optuna: A Next-generation Hyperparameter Optimization Framework
    Akiba, Takuya
    Sano, Shotaro
    Yanase, Toshihiko
    Ohta, Takeru
    Koyama, Masanori
    [J]. KDD'19: PROCEEDINGS OF THE 25TH ACM SIGKDD INTERNATIONAL CONFERENCCE ON KNOWLEDGE DISCOVERY AND DATA MINING, 2019, : 2623 - 2631
  • [4] Bader S., 2018, SEG INT EXPOSITION A
  • [5] Bahdanau D, 2016, Arxiv, DOI [arXiv:1409.0473, 10.48550/arXiv.1409.0473, DOI 10.48550/ARXIV.1409.0473]
  • [6] Machine learning methods applied to drilling rate of penetration prediction and optimization - A review
    Barbosa, Luis Felipe F. M.
    Nascimento, Andreas
    Mathias, Mauro Hugo
    de Carvalho, Joao Andrade, Jr.
    [J]. JOURNAL OF PETROLEUM SCIENCE AND ENGINEERING, 2019, 183
  • [7] A review and comparison of strategies for multi-step ahead time series forecasting based on the NN5 forecasting competition
    Ben Taieb, Souhaib
    Bontempi, Gianluca
    Atiya, Amir F.
    Sorjamaa, Antti
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2012, 39 (08) : 7067 - 7083
  • [8] Boslaugh S., 2012, Statistics in a nutshell: A desktop quick reference
  • [9] Bourgoyne A.T., 1986, APPL DRILLING ENG
  • [10] Artificial intelligence techniques and their application in oil and gas industry
    Choubey, Sachin
    Karmakar, G. P.
    [J]. ARTIFICIAL INTELLIGENCE REVIEW, 2021, 54 (05) : 3665 - 3683