Critical appraisal of artificial intelligence-based prediction models for cardiovascular disease

被引：87

作者：

van Smeden, Maarten ^{[1
]}

Heinze, Georg ^{[2
]}

Van Calster, Ben ^{[3
,4
,5
]}

Asselbergs, Folkert W. ^{[6
,7
,8
,9
]}

Vardas, Panos E. ^{[10
,11
]}

Bruining, Nico ^{[12
]}

de Jaegere, Peter ^{[12
]}

Moore, Jason H. ^{[13
]}

Denaxas, Spiros ^{[8
,9
,14
]}

Boulesteix, Anne-Laure ^{[15
]}

Moons, Karel G. M. ^{[1
]}

机构：

[1] Univ Utrecht, Univ Med Ctr Utrecht, Julius Ctr Hlth Sci & Primary Care, Univ Weg 100, NL-3584 CG Utrecht, Netherlands

[2] Med Univ Vienna, Sect Clin Biometr, Ctr Med Stat Informat & Intelligent Syst, Vienna, Austria

[3] Katholieke Univ Leuven, Dept Dev & Regenerat, Leuven, Belgium

[4] Katholieke Univ Leuven, EPI Ctr, Leuven, Belgium

[5] Leiden Univ, Dept Biomed Data Sci, Med Ctr, Leiden, Netherlands

[6] Univ Utrecht, Univ Med Ctr Utrecht, Div Heart & Lungs, Dept Cardiol, Utrecht, Netherlands

[7] UCL, Inst Cardiovasc Sci, Fac Populat Hlth Sci, London, England

[8] UCL, Hlth Data Res UK, London, England

[9] UCL, Inst Hlth Informat, London, England

[10] Herakl Univ Hosp, Dept Cardiol, Iraklion, Greece

[11] Hygeia Hosp Grp, Heart Sect, Athens, Greece

[12] Erasmus MC, Thorax Ctr, Dept Cardiol, Rotterdam, Netherlands

[13] Cedars Sinai Med Ctr, Dept Computat Biomed, Los Angeles, CA 90048 USA

[14] Alan Turing Inst, London, England

[15] Ludwig Maximilians Univ Munchen, Inst Med Informat Proc Biometry & Epidemiol, Munich, Germany

来源：

EUROPEAN HEART JOURNAL | 2022年 / 43卷 / 31期

基金：

美国国家卫生研究院;

关键词：

Digital health; Artificial intelligence; Machine learning; Diagnosis; Prognosis; Prediction; RISK; PERFORMANCE; VALIDATION; DIAGNOSIS; HEALTH; IMPACT; CARE;

D O I：

10.1093/eurheartj/ehac238

中图分类号：

R5 [内科学];

学科分类号：

1002 ; 100201 ;

摘要：

The medical field has seen a rapid increase in the development of artificial intelligence (AI)-based prediction models. With the introduction of such AI-based prediction model tools and software in cardiovascular patient care, the cardiovascular researcher and healthcare professional are challenged to understand the opportunities as well as the limitations of the AI-based predictions. In this article, we present 12 critical questions for cardiovascular health professionals to ask when confronted with an AI-based prediction model. We aim to support medical professionals to distinguish the AI-based prediction models that can add value to patient care from the AI that does not.

引用

页码：2921 / 2930

页数：10

共 78 条

[1] Update and, internal and temporal-validation of the FRANCE-2 and ACC-TAVI early-mortality prediction models for Transcatheter aortic Valve Implantation (TAVI) using data from the Netherlands heart registration (NHR) [J].

Al-Farra, Hatem ;

de Mol, Bas A. J. M. ;

Ravelli, Anita C. J. ;

ter Burg, W. J. P. P. ;

Houterman, Saskia ;

Henriques, Jose P. S. ;

Abu-Hanna, Ameen .

IJC HEART & VASCULATURE, 2021, 32

[2] Machine learning of clinical variables and coronary artery calcium scoring for the prediction of obstructive coronary artery disease on coronary computed tomography angiography: analysis from the CONFIRM registry [J].

Al'Arefilb, Subhi J. ;

Maliakal, Gabriel ;

Singh, Gurpreet ;

van Rosendael, Alexander R. ;

Ma, Xiaoyue ;

Xu, Zhuoran ;

Alawamlh, Omar Al Hussein ;

Lee, Benjamin ;

Pandey, Mohit ;

Achenbach, Stephan ;

Al-Mallah, Mouaz H. ;

Andreini, Daniele ;

Bax, Jeroen J. ;

Berman, Daniel S. ;

Budoff, Matthew J. ;

Cademartiri, Filippo ;

Canister, Tracy Q. ;

Chang, Hyuk-Jae ;

Chinnaiyan, Kavitha ;

Chow, Benjamin J. W. ;

Cury, Ricardo C. ;

DeLago, Augustin ;

Feuchtner, Gudrun ;

Hadamitzky, Martin ;

Hausleiter, Joerg ;

Kaufmann, Philipp A. ;

Kim, Yong-Jin ;

Leipsic, Jonathon A. ;

Maffei, Erica ;

Marques, Hugo ;

Goncalves, Pedro de Araujo ;

Pontone, Gianluca ;

Raff, Gilbert L. ;

Rubinshtein, Ronen ;

Villines, Todd C. ;

Gransar, Heidi ;

Lu, Yao ;

Jones, Erica C. ;

Pena, Jessica M. ;

Lin, Fay Y. ;

Min, James K. ;

Shaw, Leslee J. .

EUROPEAN HEART JOURNAL, 2020, 41 (03) :359-367

[3] Cardiovascular risk prediction models for women in the general population: A systematic review [J].

Baart, Sara J. ;

Dam, Veerle ;

Scheres, Luuk J. J. ;

Damen, Johanna A. A. G. ;

Spijker, Rene ;

Schuit, Ewoud ;

Debray, Thomas P. A. ;

Fauser, Bart C. J. M. ;

Boersma, Eric ;

Moons, Karel G. M. ;

van der Schouw, Yvonne T. ;

Appelman, Yolande ;

Baart, Sara ;

Benschop, Laura ;

Boersma, Eric ;

Brouwers, Laura ;

Budde, Ricardo P. J. ;

Cannegieter, Suzanne C. ;

Dam, Veerle ;

Eijkemans, Rene M. J. C. ;

Fauser, Bart C. J. M. ;

Ferrari, Michel D. ;

Franx, Arie ;

de Groot, Christianne J. M. ;

Gunning, Marlise N. ;

Hoek, Annemiek ;

Koffijberg, Hendrik ;

Koster, Maria P. H. ;

Kruit, Mark C. ;

Lagerweij, Ghizelda R. ;

Lambalk, Cornelis B. ;

Laven, Joop S. E. ;

Linstra, Katie M. ;

van der Lugt, Aad ;

Maas, Angela H. E. M. ;

van den Brink, Antoinette Maassen ;

Meun, Cindy ;

Middeldorp, Saskia ;

Moons, Karel G. M. ;

van Rijn, Bas B. ;

van Lennep, Jeanine E. Roeters ;

Roos-Hesselink, Jolien W. ;

Scheres, Luuk J. J. ;

van der Schouw, Yvonne T. ;

Steegers, Eric A. P. ;

Steegers-Theunissen, Regine P. M. ;

Terwindt, Gisela M. ;

Velthuis, Birgitta K. ;

Wermer, Marieke J. H. ;

Zoet, Gerbrand A. .

PLOS ONE, 2019, 14 (01)

[4] Sample-Size Determination Methodologies for Machine Learning in Medical Imaging Research: A Systematic Review [J].

Balki, Indranil ;

Amirabadi, Afsaneh ;

Levman, Jacob ;

Martel, Anne L. ;

Emersic, Ziga ;

Meden, Blaz ;

Garcia-Pedrero, Angel ;

Ramirez, Saul C. ;

Kong, Dehan ;

Moody, Alan R. ;

Tyrrell, Pascal N. .

CANADIAN ASSOCIATION OF RADIOLOGISTS JOURNAL-JOURNAL DE L ASSOCIATION CANADIENNE DES RADIOLOGISTES, 2019, 70 (04) :344-353

[5] Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI [J].

Barredo Arrieta, Alejandro ;

Diaz-Rodriguez, Natalia ;

Del Ser, Javier ;

Bennetot, Adrien ;

Tabik, Siham ;

Barbado, Alberto ;

Garcia, Salvador ;

Gil-Lopez, Sergio ;

Molina, Daniel ;

Benjamins, Richard ;

Chatila, Raja ;

Herrera, Francisco .

INFORMATION FUSION, 2020, 58 :82-115

[6] A Human-Centered Evaluation of a Deep Learning System Deployed in Clinics for the Detection of Diabetic Retinopathy [J].

Beede, Emma ;

Baylor, Elizabeth ;

Hersch, Fred ;

Iurchenko, Anna ;

Wilcox, Lauren ;

Ruamviboonsuk, Paisan ;

Vardoulakis, Laura M. .

PROCEEDINGS OF THE 2020 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS (CHI'20), 2020,

[7] Use of Expert Panels to Define the Reference Standard in Diagnostic Research: A Systematic Review of Published Methods and Reporting [J].

Bertens, Loes C. M. ;

Broekhuizen, Berna D. L. ;

Naaktgeboren, Christiana A. ;

Rutten, Frans H. ;

Hoes, Arno W. ;

van Mourik, Yvonne ;

Moons, Karel G. M. ;

Reitsma, Johannes B. .

PLOS MEDICINE, 2013, 10 (10)

[8] Advantages of the nested case-control design in diagnostic research [J].

Biesheuvel, Cornelis J. ;

Vergouwe, Yvonne ;

Oudega, Ruud ;

Hoes, Arno W. ;

Grobbee, Diederick E. ;

Moons, Karel Gm .

BMC MEDICAL RESEARCH METHODOLOGY, 2008, 8 (1)

[9] Reflection on modern methods: when worlds collide-prediction, machine learning and causal inference [J].

Blakely, Tony ;

Lynch, John ;

Simons, Koen ;

Bentley, Rebecca ;

Rose, Sherri .

INTERNATIONAL JOURNAL OF EPIDEMIOLOGY, 2020, 49 (06) :2058-2064

[10] A Practical Guide to Assess the Reproducibility of Echocardiographic Measurements [J].

Bunting, Karina V. ;

Steeds, Richard P. ;

Slater, Karin ;

Rogers, Jennifer K. ;

Gkoutos, Georgios V. ;

Kotecha, Dipak .

JOURNAL OF THE AMERICAN SOCIETY OF ECHOCARDIOGRAPHY, 2019, 32 (12) :1505-1515

← 1 2 3 4 5 6 7 8 →