Classifying and analyzing small-angle scattering data using weighted k nearest neighbors machine learning techniques

被引:34
作者
Archibald, Richard K. [1 ]
Doucet, Mathieu [2 ]
Johnston, Travis [1 ]
Young, Steven R. [1 ]
Yang, Erika [1 ]
Heller, William T. [2 ]
机构
[1] Oak Ridge Natl Lab, Comp Sci & Math Div, POB 2009, Oak Ridge, TN 37831 USA
[2] Oak Ridge Natl Lab, Neutron Scattering Div, POB 2009, Oak Ridge, TN 37831 USA
基金
欧盟地平线“2020”;
关键词
small-angle scattering data; machine learning; modeling; SasView; COMPUTER; CALIBRATION;
D O I
10.1107/S1600576720000552
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
A consistent challenge for both new and expert practitioners of small-angle scattering (SAS) lies in determining how to analyze the data, given the limited information content of said data and the large number of models that can be employed. Machine learning (ML) methods are powerful tools for classifying data that have found diverse applications in many fields of science. Here, ML methods are applied to the problem of classifying SAS data for the most appropriate model to use for data analysis. The approach employed is built around the method of weighted k nearest neighbors (wKNN), and utilizes a subset of the models implemented in the SasView package (https://www. sasview.org/) for generating a well defined set of training and testing data. The prediction rate of the wKNN method implemented here using a subset of SasView models is reasonably good for many of the models, but has difficulty with others, notably those based on spherical structures. A novel expansion of the wKNN method was also developed, which uses Gaussian processes to produce local surrogate models for the classification, and this significantly improves the classification accuracy. Further, by integrating a stochastic gradient descent method during post-processing, it is possible to leverage the local surrogate model both to classify the SAS data with high accuracy and to predict the structural parameters that best describe the data. The linking of data classification and model fitting has the potential to facilitate the translation of measured data into results for both novice and expert practitioners of SAS.
引用
收藏
页码:326 / 334
页数:9
相关论文
共 29 条
[11]   Classifying Crowdsourced Citizen Complaints through Data Mining: Accuracy Testing of k-Nearest Neighbors, Random Forest, Support Vector Machine, and AdaBoost [J].
Madyatmadja, Evaristus D. ;
Sianipar, Corinthias P. M. ;
Wijaya, Cristofer ;
Sembiring, David J. M. .
INFORMATICS-BASEL, 2023, 10 (04)
[12]   Concrete Strength Prediction Using Machine Learning Methods CatBoost, k-Nearest Neighbors, Support Vector Regression [J].
Beskopylny, Alexey N. ;
Stel'makh, Sergey A. ;
Shcherban', Evgenii M. ;
Mailyan, Levon R. ;
Meskhi, Besarion ;
Razveeva, Irina ;
Chernil'nik, Andrei ;
Beskopylny, Nikita .
APPLIED SCIENCES-BASEL, 2022, 12 (21)
[13]   Machine Learning in the development of Si-based anodes using Small-Angle X-ray Scattering for structural property analysis [J].
Seitz, Philipp ;
Scherdel, Christian ;
Reichenauer, Gudrun ;
Schmitt, Jan .
COMPUTATIONAL MATERIALS SCIENCE, 2023, 218
[14]   Handling highly imbalanced data for classifying fatality of auto collisions using machine learning techniques [J].
Xie, Shengkun ;
Zhang, Jin .
JOURNAL OF MANAGEMENT ANALYTICS, 2024, 11 (03) :317-357
[15]   Predicting COVID-19 Cases in South Korea with All K-Edited Nearest Neighbors Noise Filter and Machine Learning Techniques [J].
Oyewola, David Opeoluwa ;
Dada, Emmanuel Gbenga ;
Misra, Sanjay ;
Damasevicius, Robertas .
INFORMATION, 2021, 12 (12)
[16]   SAXSDom: Modeling multidomain protein structures using small-angle X-ray scattering data [J].
Hou, Jie ;
Adhikari, Badri ;
Tanner, John J. ;
Cheng, Jianlin .
PROTEINS-STRUCTURE FUNCTION AND BIOINFORMATICS, 2020, 88 (06) :775-787
[17]   MAP-REDUCE BASED DISTANCE WEIGHTED K-NEAREST NEIGHBOR MACHINE LEARNING ALGORITHM FOR BIG DATA APPLICATIONS [J].
Gothai, E. ;
Muthukumaran, V. ;
Valarmathi, K. ;
Sathishkumar, V. E. ;
Thillaiarasu, N. ;
Karthikeyan, P. .
SCALABLE COMPUTING-PRACTICE AND EXPERIENCE, 2022, 23 (04) :129-145
[18]   Influence of device configuration and noise on a machine learning predictor for the selection of nanoparticle small-angle X-ray scattering models [J].
Monge, Nicolas ;
Amini, Massih Reza ;
Deschamps, Alexis .
ACTA CRYSTALLOGRAPHICA A-FOUNDATION AND ADVANCES, 2024, 80 :405-413
[19]   Analyzing the effect of data preprocessing techniques using machine learning algorithms on the diagnosis of COVID-19 [J].
Erol, Gizemnur ;
Uzbas, Betul ;
Yucelbas, Cuneyt ;
Yucelbas, Sule .
CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2022, 34 (28)
[20]   Advances in the Development of Sol-Gel Materials Combining Small-Angle X-ray Scattering (SAXS) and Machine Learning (ML) [J].
Scherdel, Christian ;
Miller, Eddi ;
Reichenauer, Gudrun ;
Schmitt, Jan .
PROCESSES, 2021, 9 (04)