Transfer Learning with Transformer-Based Models for Mine Water Inrush Prediction: A Multivariate Analysis Using Sparse and Imbalanced Monitoring Data; [基于Transformer模型的矿井突水预测迁移学习: 基于稀疏和不平衡监测数据的多变量分析]; [Transfer Learning mit Transformer-basierten Modellen zur Vorhersage von Grubenwassereinbrüchen: Eine multivariate Analyse unter Verwendung von spärlichen und unausgewogenen Überwachungsdaten]; [Aprendizaje por Transferencia con Modelos Basados en Transformadores para la Predicción de Inundaciones de Agua en Minas: Un Análisis Multivariante Utilizando Datos de Monitoreo Escasos y Desequilibrados]

Predictions of mining-induced water inrush accidents are challenged by data sparseness and imbalances, as very few high-quality datasets can be obtained for successfully modeling data variation. By using the concept of transfer learning, we employed a well recorded borehole group water level dataset as a source dataset to train a selection of Transformer-based multivariate prediction models with state-of-the-art performance including PatchTST, InFormer, and AutoFormer, to capture data variation patterns in a statistically similar target dataset from a site with similar geological and mining conditions and examined the models' accident prediction performance. Additionally, the frequently used MLP-based Nbeats, RNN-based LSTM, and CNN-based TCN were adopted for the same task. In contrast to models trained merely on the target dataset, the Transformer-based models, especially PatchTST, achieved satisfactory zero-shot prediction performances in terms of accuracy, responsiveness, and anomaly detections for the early warning of accidents, proving their promising generalization capabilities for leveraging existing datasets for forecasting future accidents with data obtained in similar geological conditions. This has broad implications for mining accident prediction and groundwater risk assessment using data-driven approaches. © The Author(s) under exclusive licence to International Mine Water Association 2024.