Machine-Learning Methods on Noisy and Sparse Data

被引:57
作者
Poulinakis, Konstantinos [1 ]
Drikakis, Dimitris [1 ]
Kokkinakis, Ioannis W. [1 ]
Spottswood, Stephen Michael [2 ]
机构
[1] Univ Nicosia, CY-2417 Nicosia, Cyprus
[2] US Air Force, Res Lab, Greene Cty, OH 45433 USA
关键词
machine learning; deep neural networks; MARS; splines; interpolation; feedforward neural networks; noisy data; sparse data; ADAPTIVE REGRESSION SPLINES; ARTIFICIAL NEURAL-NETWORKS;
D O I
10.3390/math11010236
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
Experimental and computational data and field data obtained from measurements are often sparse and noisy. Consequently, interpolating unknown functions under these restrictions to provide accurate predictions is very challenging. This study compares machine-learning methods and cubic splines on the sparsity of training data they can handle, especially when training samples are noisy. We compare deviation from a true function f using the mean square error, signal-to-noise ratio and the Pearson R2 coefficient. We show that, given very sparse data, cubic splines constitute a more precise interpolation method than deep neural networks and multivariate adaptive regression splines. In contrast, machine-learning models are robust to noise and can outperform splines after a training data threshold is met. Our study aims to provide a general framework for interpolating one-dimensional signals, often the result of complex scientific simulations or laboratory experiments.
引用
收藏
页数:19
相关论文
共 39 条
[1]   Comparison of multivariate adaptive regression splines with coupled wavelet transform artificial neural networks for runoff forecasting in Himalayan micro-watersheds with limited data [J].
Adamowski, Jan ;
Chan, Hiu Fung ;
Prasher, Shiv O. ;
Sharda, Vishwa Nath .
JOURNAL OF HYDROINFORMATICS, 2012, 14 (03) :731-744
[2]  
Balestriero R., 2018, INT C MACHINE LEARNI, V80, P374
[3]   Adaptive machine learning framework to accelerate ab initio molecular dynamics [J].
Botu, Venkatesh ;
Ramprasad, Rampi .
INTERNATIONAL JOURNAL OF QUANTUM CHEMISTRY, 2015, 115 (16) :1074-1083
[4]   Experiments on a Thin Panel Excited by Turbulent Flow and Shock/Boundary-Layer Interactions [J].
Brouwer, Kirk R. ;
Perez, Ricardo A. ;
Beberniss, Timothy J. ;
Spottswood, S. Michael ;
Ehrhardt, David A. .
AIAA JOURNAL, 2021, 59 (07) :2737-2752
[5]   Surrogate-based aeroelastic loads prediction in the presence of shock-induced separation [J].
Brouwer, Kirk R. ;
McNamara, Jack J. .
JOURNAL OF FLUIDS AND STRUCTURES, 2020, 93
[6]   Mining the breast cancer pattern using artificial neural networks and multivariate adaptive regression splines [J].
Chou, SM ;
Lee, TS ;
Shao, YE ;
Chen, IF .
EXPERT SYSTEMS WITH APPLICATIONS, 2004, 27 (01) :133-142
[7]   Radar track segmentation with cubic splines for collision risk models in high density terminal areas [J].
Cozar, J. A. ;
Saez, F. J. ;
Ricaud, E. .
PROCEEDINGS OF THE INSTITUTION OF MECHANICAL ENGINEERS PART G-JOURNAL OF AEROSPACE ENGINEERING, 2015, 229 (08) :1371-1383
[8]   Model Reduction of Computational Aerothermodynamics for Hypersonic Aerothermoelasticity [J].
Crowell, Andrew R. ;
McNamara, Jack J. .
AIAA JOURNAL, 2012, 50 (01) :74-84
[9]   Extrapolation of AR models using cubic splines for damage progression evaluation in composite structures [J].
da Silva, Samuel ;
Paixao, Jesse ;
Rebillat, Marc ;
Mechbal, Nazih .
JOURNAL OF INTELLIGENT MATERIAL SYSTEMS AND STRUCTURES, 2021, 32 (03) :284-295
[10]   Experiments on aerothermoelastic fluid-structure interaction in hypersonic flow [J].
Daub, Dennis ;
Willems, Sebastian ;
Guelhan, Ali .
JOURNAL OF SOUND AND VIBRATION, 2022, 531