Five critical quality criteria for artificial intelligence-based prediction models

被引:27
作者
Van Royen, Florien S. [1 ]
Asselbergs, Folkert W. [2 ,3 ]
Alfonso, Fernando [4 ]
Vardas, Panos [5 ]
Van Smeden, Maarten [6 ,7 ]
机构
[1] Univ Utrecht, Univ Med Ctr Utrecht, Julius Ctr Hlth Sci & Primary Care, Dept Gen Practice & Nursing Sci, Utrecht, Netherlands
[2] Univ Amsterdam, Amsterdam Univ Med Ctr, Dept Cardiol, Amsterdam, Netherlands
[3] UCL, Hlth Data Res UK, London, England
[4] Univ Autonoma Madrid, Hosp Univ la Princesa, IIS IP CIVER CV, Dept Cardiol, Madrid, Spain
[5] Biomed Res Fdn Acad Athens BRFAA, Athens, Greece
[6] Univ Utrecht, Univ Med Ctr Utrecht, Julius Ctr Hlth Sci & Primary Care, Dept Epidemiol & Hlth Econ, Univ Sweg 100, NL-3584 CG Utrecht, Netherlands
[7] Univ Utrecht, Univ Med Ctr Utrecht, Julius Ctr Hlth Sci & Primary Care, Dept Data Sci & Biostat, Univ Sweg 100, NL-3584 CG Utrecht, Netherlands
基金
荷兰研究理事会;
关键词
Artificial intelligence; Digital health; Prediction; Prognosis; Diagnosis; DIGITAL HEALTH; DIAGNOSIS; CARE;
D O I
10.1093/eurheartj/ehad727
中图分类号
R5 [内科学];
学科分类号
1002 ; 100201 ;
摘要
To raise the quality of clinical artificial intelligence (AI) prediction modelling studies in the cardiovascular health domain and thereby improve their impact and relevancy, the editors for digital health, innovation, and quality standards of the European Heart Journal propose five minimal quality criteria for AI-based prediction model development and validation studies: complete reporting, carefully defined intended use of the model, rigorous validation, large enough sample size, and openness of code and software. Graphical Abstract Five critical quality criteria for artificial intelligence (AI)-based prediction models.
引用
收藏
页码:4831 / 4834
页数:4
相关论文
共 32 条
[1]   Data Sharing [J].
Alfonso, Fernando .
EUROPEAN HEART JOURNAL, 2017, 38 (18) :1361-1363
[2]   Cardiovascular risk prediction models for women in the general population: A systematic review [J].
Baart, Sara J. ;
Dam, Veerle ;
Scheres, Luuk J. J. ;
Damen, Johanna A. A. G. ;
Spijker, Rene ;
Schuit, Ewoud ;
Debray, Thomas P. A. ;
Fauser, Bart C. J. M. ;
Boersma, Eric ;
Moons, Karel G. M. ;
van der Schouw, Yvonne T. ;
Appelman, Yolande ;
Baart, Sara ;
Benschop, Laura ;
Boersma, Eric ;
Brouwers, Laura ;
Budde, Ricardo P. J. ;
Cannegieter, Suzanne C. ;
Dam, Veerle ;
Eijkemans, Rene M. J. C. ;
Fauser, Bart C. J. M. ;
Ferrari, Michel D. ;
Franx, Arie ;
de Groot, Christianne J. M. ;
Gunning, Marlise N. ;
Hoek, Annemiek ;
Koffijberg, Hendrik ;
Koster, Maria P. H. ;
Kruit, Mark C. ;
Lagerweij, Ghizelda R. ;
Lambalk, Cornelis B. ;
Laven, Joop S. E. ;
Linstra, Katie M. ;
van der Lugt, Aad ;
Maas, Angela H. E. M. ;
van den Brink, Antoinette Maassen ;
Meun, Cindy ;
Middeldorp, Saskia ;
Moons, Karel G. M. ;
van Rijn, Bas B. ;
van Lennep, Jeanine E. Roeters ;
Roos-Hesselink, Jolien W. ;
Scheres, Luuk J. J. ;
van der Schouw, Yvonne T. ;
Steegers, Eric A. P. ;
Steegers-Theunissen, Regine P. M. ;
Terwindt, Gisela M. ;
Velthuis, Birgitta K. ;
Wermer, Marieke J. H. ;
Zoet, Gerbrand A. .
PLOS ONE, 2019, 14 (01)
[3]   Protocol for development of a reporting guideline (TRIPOD-AI) and risk of bias tool (PROBAST-AI) for diagnostic and prognostic prediction model studies based on artificial intelligence [J].
Collins, Gary S. ;
Dhiman, Paula ;
Andaur Navarro, Constanza L. ;
Ma, Ji ;
Hooft, Lotty ;
Reitsma, Johannes B. ;
Logullo, Patricia ;
Beam, Andrew L. ;
Peng, Lily ;
Van Calster, Ben ;
van Smeden, Maarten ;
Riley, Richard D. ;
Moons, Karel G. M. .
BMJ OPEN, 2021, 11 (07)
[4]   Reporting of artificial intelligence prediction models [J].
Collins, Gary S. ;
Moons, Karel G. M. .
LANCET, 2019, 393 (10181) :1577-1579
[5]  
Collins GS, 2015, J CLIN EPIDEMIOL, V68, P112, DOI [10.1016/j.jclinepi.2014.11.010, 10.7326/M14-0697, 10.1016/j.eururo.2014.11.025, 10.1002/bjs.9736, 10.7326/M14-0698, 10.1038/bjc.2014.639, 10.1136/bmj.g7594, 10.1186/s12916-014-0241-z]
[6]   General cardiovascular risk profile for use in primary care - The Framingham Heart Study [J].
D'Agostino, Ralph B. ;
Vasan, Ramachandran S. ;
Pencina, Michael J. ;
Wolf, Philip A. ;
Cobain, Mark ;
Massaro, Joseph M. ;
Kannel, William B. .
CIRCULATION, 2008, 117 (06) :743-753
[7]   Prediction models for cardiovascular disease risk in the general population: systematic review [J].
Damen, Johanna A. A. G. ;
Hooft, Lotty ;
Schuit, Ewoud ;
Debray, Thomas P. A. ;
Collins, Gary S. ;
Tzoulaki, Ioanna ;
Lassale, Camille M. ;
Siontis, George C. M. ;
Chiocchia, Virginia ;
Roberts, Corran ;
Schlussel, Michael Maia ;
Gerry, Stephen ;
Black, James A. ;
Heus, Pauline ;
van der Schouw, Yvonne T. ;
Peelen, Linda M. ;
Moons, Karel G. M. .
BMJ-BRITISH MEDICAL JOURNAL, 2016, 353
[8]  
Ghassemi M, 2021, LANCET DIGIT HEALTH, V3, pE745, DOI 10.1016/S2589-7500(21)00208-9
[9]   Generalizability of Cardiovascular Disease Clinical Prediction Models: 158 Independent External Validations of 104 Unique Models [J].
Gulati, Gaurav ;
Upshaw, Jenica ;
Wessler, Benjamin S. ;
Brazil, Riley J. ;
Nelson, Jason ;
van Klaveren, David ;
Lundquist, Christine M. ;
Park, Jinny G. ;
McGinnes, Hannah ;
Steyerberg, Ewout W. ;
Van Calster, Ben ;
Kent, David M. .
CIRCULATION-CARDIOVASCULAR QUALITY AND OUTCOMES, 2022, 15 (04) :248-260
[10]   SCORE2 risk prediction algorithms: new models to estimate 10-year risk of cardiovascular disease in Europe [J].
Hageman, Steven ;
Pennells, Lisa ;
Ojeda, Francisco ;
Kaptoge, Stephen ;
Kuulasmaa, Kari ;
de Vries, Tamar ;
Xu, Zhe ;
Kee, Frank ;
Chung, Ryan ;
Wood, Angela ;
McEvoy, John William ;
Veronesi, Giovanni ;
Bolton, Thomas ;
Dendale, Paul ;
Ference, Brian A. ;
Halle, Martin ;
Timmis, Adam ;
Vardas, Panos ;
Danesh, John ;
Graham, Ian ;
Salomaa, Veikko ;
Visseren, Frank ;
De Bacquer, Dirk ;
Blankenberg, Stefan ;
Dorresteijn, Jannick ;
Di Angelantonio, Emanuele ;
Achenbach, Stephan ;
Aleksandrova, Krasimira ;
Amiano, Pilar ;
Amouyel, Philippe ;
Andersson, Jonas ;
Bakker, Stephan J. L. ;
Costa, Rui Bebiano Da Providencia ;
Beulens, Joline W. J. ;
Blaha, Michael ;
Bobak, Martin ;
Boer, Jolanda M. A. ;
Bonet, Catalina ;
Bonnet, Fabrice ;
Boutron-Ruault, Marie-Christine ;
Braaten, Tonje ;
Brenner, Hermann ;
Brunner, Fabian ;
Brunner, Eric J. ;
Brunstrom, Mattias ;
Buring, Julie ;
Butterworth, Adam S. ;
Capkova, Nadezda ;
Cesana, Giancarlo ;
Chrysohoou, Christina .
EUROPEAN HEART JOURNAL, 2021, 42 (25) :2439-2454