The need to separate the wheat from the chaff in medical informatics Introducing a comprehensive checklist for the (self)-assessment of medical AI studies

被引:178
作者
Cabitza, Federico [1 ]
Campagner, Andrea [1 ]
机构
[1] Univ Milano Bicocca, DISCO, Viale Sarca 336, I-20126 Milan, Italy
关键词
Medical artificial intelligence; Machine learning; Checklist; Quality auditing; ARTIFICIAL-INTELLIGENCE; EXTERNAL VALIDATION; BIG DATA; PERFORMANCE; GUIDELINES; PROMISE; MODEL;
D O I
10.1016/j.ijmedinf.2021.104510
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This editorial aims to contribute to the current debate about the quality of studies that apply machine learning (ML) methodologies to medical data to extract value from them and provide clinicians with viable and useful tools supporting everyday care practices. We propose a practical checklist to help authors to self assess the quality of their contribution and to help reviewers to recognize and appreciate high-quality medical ML studies by distinguishing them from the mere application of ML techniques to medical data.
引用
收藏
页数:7
相关论文
共 94 条
[41]   Why most published research findings are false [J].
Ioannidis, JPA .
PLOS MEDICINE, 2005, 2 (08) :696-701
[42]  
Johner C., 2021, ITU WHO FOC GROUP AR
[43]   MIMIC-III, a freely accessible critical care database [J].
Johnson, Alistair E. W. ;
Pollard, Tom J. ;
Shen, Lu ;
Lehman, Li-wei H. ;
Feng, Mengling ;
Ghassemi, Mohammad ;
Moody, Benjamin ;
Szolovits, Peter ;
Celi, Leo Anthony ;
Mark, Roger G. .
SCIENTIFIC DATA, 2016, 3
[44]   Leakage in Data Mining: Formulation, Detection, and Avoidance [J].
Kaufman, Shachar ;
Rosset, Saharon ;
Perlich, Claudia ;
Stitelman, Ori .
ACM TRANSACTIONS ON KNOWLEDGE DISCOVERY FROM DATA, 2012, 6 (04)
[45]   Key challenges for delivering clinical impact with artificial intelligence [J].
Kelly, Christopher J. ;
Karthikesalingam, Alan ;
Suleyman, Mustafa ;
Corrado, Greg ;
King, Dominic .
BMC MEDICINE, 2019, 17 (01)
[46]  
Krippendorff K., 2019, Content analysis: An introduction to its methodology
[47]  
Lavin A., 2021, ARXIV210103989
[48]  
Lee CH, 2017, KIDNEY RES CLIN PRAC, V36, P3, DOI 10.23876/j.krcp.2017.36.1.3
[49]   Is Artificial Intelligence Better Than Human Clinicians in Predicting Patient Outcomes? [J].
Lee, Joon .
JOURNAL OF MEDICAL INTERNET RESEARCH, 2020, 22 (08)
[50]  
Linstone HA, 1975, The Delphi method