Combination of Feature Selection and Resampling Methods to Predict Preterm Birth Based on Electrohysterographic Signals from Imbalance Data

被引:14
作者
Nieto-del-Amor, Felix [1 ]
Prats-Boluda, Gema [1 ]
Garcia-Casado, Javier [1 ]
Diaz-Martinez, Alba [1 ]
Jose Diago-Almela, Vicente [2 ]
Monfort-Ortiz, Rogelio [2 ]
Hao, Dongmei [3 ]
Ye-Lin, Yiyao [1 ]
机构
[1] Univ Politecn Valencia, Ctr Invest & Innovac Bioingn, E-46022 Valencia, Spain
[2] HUP La Fe, Serv Obstet, Valencia 46026, Spain
[3] Beijing Univ Technol, Fac Environm & Life, Beijing Int Sci & Technol Cooperat Base Intellige, Beijing 100124, Peoples R China
关键词
genetic algorithm; imbalance data learning; electrohysterography; preterm labor prediction; resampling methods; uterine electromyography; machine learning; CLASSIFICATION; CLASSIFIERS; PERFORMANCE; ALGORITHM; ACCURACY; LABOR; TERM; SETS;
D O I
10.3390/s22145098
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Due to its high sensitivity, electrohysterography (EHG) has emerged as an alternative technique for predicting preterm labor. The main obstacle in designing preterm labor prediction models is the inherent preterm/term imbalance ratio, which can give rise to relatively low performance. Numerous studies obtained promising preterm labor prediction results using the synthetic minority oversampling technique. However, these studies generally overestimate mathematical models' real generalization capacity by generating synthetic data before splitting the dataset, leaking information between the training and testing partitions and thus reducing the complexity of the classification task. In this work, we analyzed the effect of combining feature selection and resampling methods to overcome the class imbalance problem for predicting preterm labor by EHG. We assessed undersampling, oversampling, and hybrid methods applied to the training and validation dataset during feature selection by genetic algorithm, and analyzed the resampling effect on training data after obtaining the optimized feature subset. The best strategy consisted of undersampling the majority class of the validation dataset to 1:1 during feature selection, without subsequent resampling of the training data, achieving an AUC of 94.5 +/- 4.6%, average precision of 84.5 +/- 11.7%, maximum F1-score of 79.6 +/- 13.8%, and recall of 89.8 +/- 12.1%. Our results outperformed the techniques currently used in clinical practice, suggesting the EHG could be used to predict preterm labor in clinics.
引用
收藏
页数:18
相关论文
共 75 条
[61]   Sample size, power and effect size revisited: simplified and practical approaches in pre-clinical, clinical and laboratory studies [J].
Serdar, Ceyhan Ceran ;
Cihan, Murat ;
Yucel, Dogan ;
Serdar, Muhittin A. .
BIOCHEMIA MEDICA, 2021, 31 (01) :1-27
[62]   Separating sets of term and pre-term uterine EMG records [J].
Smrdel, A. ;
Jager, F. .
PHYSIOLOGICAL MEASUREMENT, 2015, 36 (02) :341-355
[63]   The area under the precision-recall curve as a performance metric for rare binary events [J].
Sofaer, Helen R. ;
Hoeting, Jennifer A. ;
Jarnevich, Catherine S. .
METHODS IN ECOLOGY AND EVOLUTION, 2019, 10 (04) :565-577
[64]   CLASSIFICATION OF IMBALANCED DATA: A REVIEW [J].
Sun, Yanmin ;
Wong, Andrew K. C. ;
Kamel, Mohamed S. .
INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2009, 23 (04) :687-719
[65]   Overly optimistic prediction results on imbalanced data: a case study of flaws and benefits when applying over-sampling [J].
Vandewiele, Gilles ;
Dehaene, Isabelle ;
Kovacs, Gyorgy ;
Sterckx, Lucas ;
Janssens, Olivier ;
Ongenae, Femke ;
Backere, Femke De ;
Turck, Filip De ;
Roelens, Kristien ;
Decruyenaere, Johan ;
Van Hoecke, Sofie ;
Demeester, Thomas .
ARTIFICIAL INTELLIGENCE IN MEDICINE, 2021, 111
[66]  
Vluymans S., 2019, STUD COMPUT INTELL, P81, DOI [10.1007/978-3-030-04663-74, DOI 10.1007/978-3-030-04663-7_4]
[67]   The global epidemiology of preterm birth [J].
Vogel, Joshua P. ;
Chawanpaiboon, Saifon ;
Moller, Ann-Beth ;
Watananirun, Kanokwaroon ;
Bonet, Mercedes ;
Lumbiganon, Pisake .
BEST PRACTICE & RESEARCH CLINICAL OBSTETRICS & GYNAECOLOGY, 2018, 52 :3-12
[68]  
Vrhovec J., 2012, APPL EMG CLIN SPORTS
[69]  
Vuttipittayamongkol P., 2020, IFIP INT C ARTIFICIA, P358, DOI DOI 10.1007/978-3-030-49186-4_30
[70]   On the class overlap problem in imbalanced data classification [J].
Vuttipittayamongkol, Pattaramon ;
Elyan, Eyad ;
Petrovski, Andrei .
KNOWLEDGE-BASED SYSTEMS, 2021, 212 (212)