MLReal: Bridging the gap between training on synthetic data and real data applications in machine learning

被引:33
作者
Alkhalifah, Tariq [1 ]
Wang, Hanchen [1 ]
Ovcharenko, Oleg [1 ]
机构
[1] King Abdullah Univ Sci & Technol, Phys Sci & Engn, Mail Box 1280, Thuwal 239556900, Saudi Arabia
来源
ARTIFICIAL INTELLIGENCE IN GEOSCIENCES | 2022年 / 3卷
关键词
Neural networks; Induced seismicity; Image processing; Computational seismology; Waveform inversion; INVERSION;
D O I
10.1016/j.aiig.2022.09.002
中图分类号
P [天文学、地球科学];
学科分类号
07 ;
摘要
Among the biggest challenges we face in utilizing neural networks trained on waveform (i.e., seismic, electromagnetic, or ultrasound) data is its application to real data. The requirement for accurate labels often forces us to train our networks using synthetic data, where labels are readily available. However, synthetic data often fail to capture the reality of the field/real experiment, and we end up with poor performance of the trained neural networks (NNs) at the inference stage. This is because synthetic data lack many of the realistic features embedded in real data, including an accurate waveform source signature, realistic noise, and accurate reflectivity. In other words, the real data set is far from being a sample from the distribution of the synthetic training set. Thus, we describe a novel approach to enhance our supervised neural network (NN) training on synthetic data with real data features (domain adaptation). Specifically, for tasks in which the absolute values of the vertical axis (time or depth) of the input section are not crucial to the prediction, like classification, or can be corrected after the prediction, like velocity model building using a well, we suggest a series of linear operations on the input to the network data so that the training and application data have similar distributions. This is accomplished by applying two operations on the input data to the NN, whether the input is from the synthetic or real data subset domain: (1) The crosscorrelation of the input data section (i.e., shot gather, seismic image, etc.) with a fixed-location reference trace from the input data section. (2) The convolution of the resulting data with the mean (or a random sample) of the autocorrelated sections from the other subset domain. In the training stage, the input data are from the synthetic subset domain and the auto-corrected (we crosscorrelate each trace with itself) sections are from the real subset domain, and the random selection of sections from the real data is implemented at every epoch of the training. In the inference/application stage, the input data are from the real subset domain and the mean of the autocorrelated sections are from the synthetic data subset domain. Example applications on passive seismic data for microseismic event source location determination and on active seismic data for predicting low frequencies are used to demonstrate the power of this approach in improving the applicability of our trained NNs to real data.
引用
收藏
页码:101 / 114
页数:14
相关论文
共 46 条
  • [1] Aki K., 2002, QUANTITATIVE SEISMOL
  • [2] Palladino JA, 2020, Arxiv, DOI arXiv:2009.04985
  • [3] Deep learning-driven velocity model building workflow
    Araya-Polo M.
    Farris S.
    Florez M.
    [J]. Leading Edge, 2019, 38 (11) : 872A1 - 872A9
  • [4] Araya-Polo Mauricio, 2018, Leading Edge, V37, P58, DOI 10.1190/tle37010058.1
  • [5] Ben-David S, 2006, Advances in Neural Information Processing Systems, P137, DOI DOI 10.7551/MITPRESS/7503.003.0022
  • [6] Birnie C.E., 2018, Statistical methods for ambient noise characterisation, modelling and suppression: Theory and applications for surface microseismic monitoring
  • [7] A simple method for earthquake location by surface-wave time reversal
    Boschi, Lapo
    Molinari, Irene
    Reinwald, Michael
    [J]. GEOPHYSICAL JOURNAL INTERNATIONAL, 2018, 215 (01) : 1 - 21
  • [8] LINEARIZED INVERSION - A SIGNIFICANT STEP BEYOND PRE-STACK MIGRATION
    BOURGEOIS, A
    JIANG, BF
    LAILLY, P
    [J]. GEOPHYSICAL JOURNAL INTERNATIONAL, 1989, 99 (02) : 435 - 445
  • [9] Choi Y, 2011, GEOPHYSICS, V76, pR125, DOI [10.1190/GEO2010-0210.1, 10.1190/geo2010-0210.1]
  • [10] Chollet F., 2017, DEEP LEARNING PYTHON