Developing an Explainable Machine Learning-Based Personalised Dementia Risk Prediction Model: A Transfer Learning Approach With Ensemble Learning Algorithms

被引:43
作者
Danso, Samuel O. [1 ]
Zeng, Zhanhang [2 ]
Muniz-Terrera, Graciela [1 ]
Ritchie, Craig W. [1 ]
机构
[1] Univ Edinburgh, Edinburgh Dementia Prevent, Ctr Clin Brain Sci, Sch Med, Edinburgh, Midlothian, Scotland
[2] Univ Edinburgh, Sch Informat, Edinburgh, Midlothian, Scotland
来源
FRONTIERS IN BIG DATA | 2021年 / 4卷
关键词
early detection; risk factors; Alzheimer' s; personalised dementia risk; explainable AI model; ensemble-based learning; MILD COGNITIVE IMPAIRMENT; PREVENTION; ALZHEIMERS; INTERVENTION;
D O I
10.3389/fdata.2021.613047
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Alzheimer's disease (AD) has its onset many decades before dementia develops, and work is ongoing to characterise individuals at risk of decline on the basis of early detection through biomarker and cognitive testing as well as the presence/absence of identified risk factors. Risk prediction models for AD based on various computational approaches, including machine learning, are being developed with promising results. However, these approaches have been criticised as they are unable to generalise due to over-reliance on one data source, poor internal and external validations, and lack of understanding of prediction models, thereby limiting the clinical utility of these prediction models. We propose a framework that employs a transfer-learning paradigm with ensemble learning algorithms to develop explainable personalised risk prediction models for dementia. Our prediction models, known as source models, are initially trained and tested using a publicly available dataset (n = 84,856, mean age = 69 years) with 14 years of follow-up samples to predict the individual risk of developing dementia. The decision boundaries of the best source model are further updated by using an alternative dataset from a different and much younger population (n = 473, mean age = 52 years) to obtain an additional prediction model known as the target model. We further apply the SHapely Additive exPlanation (SHAP) algorithm to visualise the risk factors responsible for the prediction at both population and individual levels. The best source model achieves a geometric accuracy of 87%, specificity of 99%, and sensitivity of 76%. In comparison to a baseline model, our target model achieves better performance across several performance metrics, within an increase in geometric accuracy of 16.9%, specificity of 2.7%, and sensitivity of 19.1%, an area under the receiver operating curve (AUROC) of 11% and a transfer learning efficacy rate of 20.6%. The strength of our approach is the large sample size used in training the source model, transferring and applying the "knowledge" to another dataset from a different and undiagnosed population for the early detection and prediction of dementia risk, and the ability to visualise the interaction of the risk factors that drive the prediction. This approach has direct clinical utility.
引用
收藏
页数:14
相关论文
共 42 条
[11]  
Efron B, 1994, INTRO BOOTSTRAP
[12]   Machine learning approaches to studying the role of cognitive reserve in conversion from mild cognitive impairment to dementia [J].
Facal, David ;
Valladares-Rodriguez, Sonia ;
Lojo-Seoane, Cristina ;
Pereiro, Arturo X. ;
Anido-Rifon, Luis ;
Juncos-Rabadan, Onesimo .
INTERNATIONAL JOURNAL OF GERIATRIC PSYCHIATRY, 2019, 34 (07) :941-949
[13]  
Fernandez A., 2018, Learning from imbalanced data sets, DOI DOI 10.1007/978-3-319-98074-4
[14]   Precision prevention of Alzheimer's and other dementias: Anticipating future needs in the control of risk factors and implementation of disease-modifying therapies [J].
Frisoni, Giovanni B. ;
Luis Molinuevo, Jose ;
Altomare, Daniele ;
Carrera, Emmanuel ;
Barkhof, Frederik ;
Berkhof, Johannes ;
Delrieu, Julien ;
Dubois, Bruno ;
Kivipelto, Miia ;
Nordberg, Agneta ;
Schott, Jonathan M. ;
van der Flier, Wiesje M. ;
Vellas, Bruno ;
Jessen, Frank ;
Scheltens, Philip ;
Ritchie, Craig .
ALZHEIMERS & DEMENTIA, 2020, 16 (10) :1457-1468
[15]   2019 Alzheimer's disease facts and figures [J].
Gaugler, Joseph ;
James, Bryan ;
Johnson, Tricia ;
Marin, Allison ;
Weuve, Jennifer .
ALZHEIMERS & DEMENTIA, 2019, 15 (03) :321-387
[16]   Statistical methods for dementia risk prediction and recommendations for future work: A systematic review [J].
Goerdten, Jantje ;
Cukic, Iva ;
Danso, Samuel O. ;
Carriere, Isabelle ;
Muniz-Terrera, Graciela .
ALZHEIMERS & DEMENTIA-TRANSLATIONAL RESEARCH & CLINICAL INTERVENTIONS, 2019, 5 (01) :563-569
[17]   A targeted real-time early warning score (TREWScore) for septic shock [J].
Henry, Katharine E. ;
Hager, David N. ;
Pronovost, Peter J. ;
Saria, Suchi .
SCIENCE TRANSLATIONAL MEDICINE, 2015, 7 (299)
[18]   Artificial intelligence for breast cancer screening: Opportunity or hype? [J].
Houssami, Nehmat ;
Lee, Christoph I. ;
Buist, Diana S. M. ;
Tao, Dacheng .
BREAST, 2017, 36 :31-33
[19]  
Johnson DK, 2009, ARCH NEUROL-CHICAGO, V66, P1254, DOI 10.1001/archneurol.2009.158
[20]   Predicting disease risks from highly imbalanced data using random forest [J].
Khalilia, Mohammed ;
Chakraborty, Sounak ;
Popescu, Mihail .
BMC MEDICAL INFORMATICS AND DECISION MAKING, 2011, 11