Guidelines for clinical trial protocols for interventions involving artificial intelligence: the SPIRIT-AI extension

被引:1
作者
Rivera, Samantha Cruz [1 ,2 ,3 ]
Liu, Xiaoxuan [3 ,4 ,5 ,6 ,7 ]
Chan, An-Wen [8 ]
Denniston, Alastair K. [1 ,3 ,4 ,5 ,6 ,9 ]
Calvert, Melanie J. [1 ,2 ,3 ,10 ,11 ,12 ]
机构
[1] Univ Birmingham, Inst Appl Hlth Res, Ctr Patient Reported Outcomes Res, Reino Unido, North Ireland
[2] Univ Birmingham, Inst Appl Hlth Res, Reino Unido, North Ireland
[3] Univ Birmingham, Birmingham Hlth Partners Ctr Regulatory Sci & Inno, Birmingham, Warwickshire, England
[4] Univ Birmingham, Inst Inflammat & Ageing, Acad Unit Ophthalmol, Birmingham, Warwickshire, England
[5] Univ Hosp Birmingham NHS Fdn Trust, Birmingham, Warwickshire, England
[6] Hlth Data Res UK, Reino Unido, North Ireland
[7] Moorfields Eye Hosp NHS Fdn Trust, Reino Unido, North Ireland
[8] Univ Toronto, Womens Coll Hosp, Womens Coll Res Inst, Dept Med, Toronto, ON, Canada
[9] Moorfields Hosp London NHS Fdn Trust, Natl Inst Hlth Res Biomed Res Ctr Ophthalmol, London, England
[10] Univ Birmingham, Natl Inst Hlth Res Birmingham Biomed Res Ctr, Birmingham, England
[11] Natl Inst Hlth Res Appl Res Collaborat West Midlan, Coventry, Warwickshire, England
[12] Univ Birmingham, Microbiol Ctr, Birmingham, England
来源
REVISTA PANAMERICANA DE SALUD PUBLICA-PAN AMERICAN JOURNAL OF PUBLIC HEALTH | 2024年 / 48卷
基金
英国科研创新办公室; 英国工程与自然科学研究理事会;
关键词
SYSTEM; PREDICTION; STATEMENT; CANCER;
D O I
10.26633/RPSP.2024.12
中图分类号
R1 [预防医学、卫生学];
学科分类号
1004 ; 120402 ;
摘要
The SPIRIT 2013 declaration aims to improve the exhaustiveness of clinical trial protocol reports by providing evidence-based recommendations for the minimum set of elements that must be addressed. This guide has been fundamental in promoting the transparent evaluation of new interventions. More recently, it has been increasingly recognized that interventions with artificial intelligence (AI) must undergo rigorous and prospective evaluation to demonstrate their impact on medical outcomes. The SPIRIT-AI extension (Standard Protocol Items: Recommendations for Interventional Trials-Artificial Intelligence, by its acronym in English) is a new guideline for the reporting of clinical trial protocols that evaluate interventions with an AI component. This guideline was developed in parallel with its complementary declaration for clinical trial reports: CONSORT-AI (Consolidated Standards of Reporting Trials-Artificial Intelligence). Both guidelines were developed through a staged consensus process that included literature review and consultation with experts to generate 26 candidate items, which were consulted by an international group of multiple interested parties in a two-stage Delphi survey ( 103 interested parties), agreed in a consensus meeting (31 interested parties) and refined through a pilot checklist (34 participants). The expansion of SPIRIT-AI includes 15 new elements that are considered sufficiently important for clinical trial protocols with AI interventions. These new items must be reported routinely in addition to the central items of SPIRIT 2013. SPIRIT-AI recommends that researchers provide clear descriptions of the AI intervention, including the instructions and skills necessary for its use, the environment into which it will be integrated the AI intervention, the considerations for the management of input and output data, the interaction between the human being and the AI and the analysis of error cases. SPIRIT-AI will help promote transparency and exhaustiveness of clinical trial protocols for AI interventions. Its use will help editors and reviewers, as well as readers in general, to understand, interpret and critically value the design and risk of a future clinical trial.
引用
收藏
页数:17
相关论文
共 52 条
[11]   Adversarial attacks on medical machine learning [J].
Finlayson, Samuel G. ;
Bowers, John D. ;
Ito, Joichi ;
Zittrain, Jonathan L. ;
Beam, Andrew L. ;
Kohane, Isaac S. .
SCIENCE, 2019, 363 (6433) :1287-1289
[12]   Machine learning for the prediction of sepsis: a systematic review and meta-analysis of diagnostic test accuracy [J].
Fleuren, Lucas M. ;
Klausch, Thomas L. T. ;
Zwager, Charlotte L. ;
Schoonmade, Linda J. ;
Guo, Tingjie ;
Roggeveen, Luca F. ;
Swart, Eleonora L. ;
Girbes, Armand R. J. ;
Thoral, Patrick ;
Ercole, Ari ;
Hoogendoorn, Mark ;
Elbers, Paul W. G. .
INTENSIVE CARE MEDICINE, 2020, 46 (03) :383-400
[13]   Detection of colorectal adenomas with a real-time computer-aided system (ENDOANGEL): a randomised controlled study [J].
Gong, Dexin ;
Wu, Lianlian ;
Zhang, Jun ;
Mu, Ganggang ;
Shen, Lei ;
Liu, Jun ;
Wang, Zhengqiang ;
Zhou, Wei ;
An, Ping ;
Huang, Xu ;
Jiang, Xiaoda ;
Li, Yanxia ;
Wan, Xinyue ;
Hu, Shan ;
Chen, Yiyun ;
Hu, Xiao ;
Xu, Youming ;
Zhu, Xiaoyun ;
Li, Suqin ;
Yao, Liwen ;
He, Xinqi ;
Chen, Di ;
Huang, Li ;
Wei, Xiao ;
Wang, Xuemei ;
Yu, Honggang .
LANCET GASTROENTEROLOGY & HEPATOLOGY, 2020, 5 (04) :352-361
[14]   Top 10 Reviewer Critiques of Radiology Artificial Intelligence (AI) Articles: Qualitative Thematic Analysis of Reviewer Critiques of Machine Learning/Deep Learning Manuscripts Submitted to JMRI [J].
Gregory, Jules ;
Welliver, Sara ;
Chong, Jaron .
JOURNAL OF MAGNETIC RESONANCE IMAGING, 2020, 52 (01) :248-254
[15]  
Pooch EHP, 2020, Arxiv, DOI [arXiv:1909.01940, 10.1007/978-3-030-62469-9_7, DOI 10.1007/978-3-030-62469-9_7]
[16]   Artificial intelligence in health care: accountability and safety [J].
Habli, Ibrahim ;
Lawton, Tom ;
Porter, Zoe .
BULLETIN OF THE WORLD HEALTH ORGANIZATION, 2020, 98 (04) :251-256
[17]   The practical implementation of artificial intelligence technologies in medicine [J].
He, Jianxing ;
Baxter, Sally L. ;
Xu, Jie ;
Xu, Jiming ;
Zhou, Xingtao ;
Zhang, Kang .
NATURE MEDICINE, 2019, 25 (01) :30-36
[18]  
Heaven D, 2019, NATURE, V574, P163, DOI 10.1038/d41586-019-03013-5
[19]  
International Medical Device Regulators Forum, 2019, Unique Device Identification system (UDI system) Application Guide
[20]   Key challenges for delivering clinical impact with artificial intelligence [J].
Kelly, Christopher J. ;
Karthikesalingam, Alan ;
Suleyman, Mustafa ;
Corrado, Greg ;
King, Dominic .
BMC MEDICINE, 2019, 17 (01)