Guidelines for clinical trial protocols for interventions involving artificial intelligence: the SPIRIT-AI extension

被引:1
作者
Rivera, Samantha Cruz [1 ,2 ,3 ]
Liu, Xiaoxuan [3 ,4 ,5 ,6 ,7 ]
Chan, An-Wen [8 ]
Denniston, Alastair K. [1 ,3 ,4 ,5 ,6 ,9 ]
Calvert, Melanie J. [1 ,2 ,3 ,10 ,11 ,12 ]
机构
[1] Univ Birmingham, Inst Appl Hlth Res, Ctr Patient Reported Outcomes Res, Reino Unido, North Ireland
[2] Univ Birmingham, Inst Appl Hlth Res, Reino Unido, North Ireland
[3] Univ Birmingham, Birmingham Hlth Partners Ctr Regulatory Sci & Inno, Birmingham, Warwickshire, England
[4] Univ Birmingham, Inst Inflammat & Ageing, Acad Unit Ophthalmol, Birmingham, Warwickshire, England
[5] Univ Hosp Birmingham NHS Fdn Trust, Birmingham, Warwickshire, England
[6] Hlth Data Res UK, Reino Unido, North Ireland
[7] Moorfields Eye Hosp NHS Fdn Trust, Reino Unido, North Ireland
[8] Univ Toronto, Womens Coll Hosp, Womens Coll Res Inst, Dept Med, Toronto, ON, Canada
[9] Moorfields Hosp London NHS Fdn Trust, Natl Inst Hlth Res Biomed Res Ctr Ophthalmol, London, England
[10] Univ Birmingham, Natl Inst Hlth Res Birmingham Biomed Res Ctr, Birmingham, England
[11] Natl Inst Hlth Res Appl Res Collaborat West Midlan, Coventry, Warwickshire, England
[12] Univ Birmingham, Microbiol Ctr, Birmingham, England
来源
REVISTA PANAMERICANA DE SALUD PUBLICA-PAN AMERICAN JOURNAL OF PUBLIC HEALTH | 2024年 / 48卷
基金
英国科研创新办公室; 英国工程与自然科学研究理事会;
关键词
SYSTEM; PREDICTION; STATEMENT; CANCER;
D O I
10.26633/RPSP.2024.12
中图分类号
R1 [预防医学、卫生学];
学科分类号
1004 ; 120402 ;
摘要
The SPIRIT 2013 declaration aims to improve the exhaustiveness of clinical trial protocol reports by providing evidence-based recommendations for the minimum set of elements that must be addressed. This guide has been fundamental in promoting the transparent evaluation of new interventions. More recently, it has been increasingly recognized that interventions with artificial intelligence (AI) must undergo rigorous and prospective evaluation to demonstrate their impact on medical outcomes. The SPIRIT-AI extension (Standard Protocol Items: Recommendations for Interventional Trials-Artificial Intelligence, by its acronym in English) is a new guideline for the reporting of clinical trial protocols that evaluate interventions with an AI component. This guideline was developed in parallel with its complementary declaration for clinical trial reports: CONSORT-AI (Consolidated Standards of Reporting Trials-Artificial Intelligence). Both guidelines were developed through a staged consensus process that included literature review and consultation with experts to generate 26 candidate items, which were consulted by an international group of multiple interested parties in a two-stage Delphi survey ( 103 interested parties), agreed in a consensus meeting (31 interested parties) and refined through a pilot checklist (34 participants). The expansion of SPIRIT-AI includes 15 new elements that are considered sufficiently important for clinical trial protocols with AI interventions. These new items must be reported routinely in addition to the central items of SPIRIT 2013. SPIRIT-AI recommends that researchers provide clear descriptions of the AI intervention, including the instructions and skills necessary for its use, the environment into which it will be integrated the AI intervention, the considerations for the management of input and output data, the interaction between the human being and the AI and the analysis of error cases. SPIRIT-AI will help promote transparency and exhaustiveness of clinical trial protocols for AI interventions. Its use will help editors and reviewers, as well as readers in general, to understand, interpret and critically value the design and risk of a future clinical trial.
引用
收藏
页数:17
相关论文
共 52 条
[1]   Improved Automated Detection of Diabetic Retinopathy on a Publicly Available Dataset Through Integration of Deep Learning [J].
Abramoff, Michael David ;
Lou, Yiyue ;
Erginay, Ali ;
Clarida, Warren ;
Amelon, Ryan ;
Folk, James C. ;
Niemeijer, Meindert .
INVESTIGATIVE OPHTHALMOLOGY & VISUAL SCIENCE, 2016, 57 (13) :5200-5206
[2]   A web-based clinical decision support system for gestational diabetes: Automatic diet prescription and detection of insulin needs [J].
Caballero-Ruiz, Estefania ;
Garcia-Saez, Gema ;
Rigla, Mercedes ;
Villaplana, Maria ;
Pons, Belen ;
Elena Hernando, M. .
INTERNATIONAL JOURNAL OF MEDICAL INFORMATICS, 2017, 102 :35-49
[3]   Guidelines for Inclusion of Patient-Reported Outcomes in Clinical Trial Protocols The SPIRIT-PRO Extension [J].
Calvert, Melanie ;
Kyte, Derek ;
Mercieca-Bebber, Rebecca ;
Slade, Anita ;
Chan, An-Wen ;
King, Madeleine T. .
JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION, 2018, 319 (05) :483-494
[4]   SPIRIT 2013 Statement: Defining Standard Protocol Items for Clinical Trials [J].
Chan, An-Wen ;
Tetzlaff, Jennifer M. ;
Altman, Douglas G. ;
Laupacis, Andreas ;
Gotzsche, Peter C. ;
Krleza-Jeric, Karmela ;
Hrobjartsson, Asbjorn ;
Mann, Howard ;
Dickersin, Kay ;
Berlin, Jesse A. ;
Dore, Caroline J. ;
Parulekar, Wendy R. ;
Summerskill, William S. M. ;
Groves, Trish ;
Schulz, Kenneth F. ;
Sox, Harold C. ;
Rockhold, Frank W. ;
Rennie, Drummond ;
Moher, David .
ANNALS OF INTERNAL MEDICINE, 2013, 158 (03) :200-+
[5]   SPIRIT 2013 explanation and elaboration: guidance for protocols of clinical trials [J].
Chan, An-Wen ;
Tetzlaff, Jennifer M. ;
Gotzsche, Peter C. ;
Altman, Douglas G. ;
Mann, Howard ;
Berlin, Jesse A. ;
Dickersin, Kay ;
Hrobjartsson, Asbjorn ;
Schulz, Kenneth F. ;
Parulekar, Wendy R. ;
Krleza-Jeric, Karmela ;
Laupacis, Andreas ;
Moher, David .
BMJ-BRITISH MEDICAL JOURNAL, 2013, 346
[6]   Development and Validation of a Deep Learning System for Staging Liver Fibrosis by Using Contrast Agent-enhanced CT Images in the Liver [J].
Choi, Kyu Jin ;
Jang, Jong Keon ;
Lee, Seung Soo ;
Sung, Yu Sub ;
Shim, Woo Hyun ;
Kim, Ho Sung ;
Yun, Jessica ;
Choi, Jin-Young ;
Lee, Yedaun ;
Kang, Bo-Kyeong ;
Kim, Jin Hee ;
Kim, So Yeon ;
Yu, Eun Sil .
RADIOLOGY, 2018, 289 (03) :688-697
[7]   Reporting of artificial intelligence prediction models [J].
Collins, Gary S. ;
Moons, Karel G. M. .
LANCET, 2019, 393 (10181) :1577-1579
[8]   Standard Protocol Items for Clinical Trials with Traditional Chinese Medicine 2018: Recommendations, Explanation and Elaboration (SPIRIT-TCM Extension 2018) [J].
Dai Liang ;
Cheng Chung-wah ;
Tian Ran ;
Zhong, Linda L. D. ;
Li You-ping ;
Lyu Ai-ping ;
Chan An-wen ;
Shang Hong-cai ;
Bian Zhao-xiang .
CHINESE JOURNAL OF INTEGRATIVE MEDICINE, 2019, 25 (01) :71-79
[9]   Clinically applicable deep learning for diagnosis and referral in retinal disease [J].
De Fauw, Jeffrey ;
Ledsam, Joseph R. ;
Romera-Paredes, Bernardino ;
Nikolov, Stanislav ;
Tomasev, Nenad ;
Blackwell, Sam ;
Askham, Harry ;
Glorot, Xavier ;
O'Donoghue, Brendan ;
Visentin, Daniel ;
van den Driessche, George ;
Lakshminarayanan, Balaji ;
Meyer, Clemens ;
Mackinder, Faith ;
Bouton, Simon ;
Ayoub, Kareem ;
Chopra, Reena ;
King, Dominic ;
Karthikesalingam, Alan ;
Hughes, Cian O. ;
Raine, Rosalind ;
Hughes, Julian ;
Sim, Dawn A. ;
Egan, Catherine ;
Tufail, Adnan ;
Montgomery, Hugh ;
Hassabis, Demis ;
Rees, Geraint ;
Back, Trevor ;
Khaw, Peng T. ;
Suleyman, Mustafa ;
Cornebise, Julien ;
Keane, Pearse A. ;
Ronneberger, Olaf .
NATURE MEDICINE, 2018, 24 (09) :1342-+
[10]   Dermatologist-level classification of skin cancer with deep neural networks [J].
Esteva, Andre ;
Kuprel, Brett ;
Novoa, Roberto A. ;
Ko, Justin ;
Swetter, Susan M. ;
Blau, Helen M. ;
Thrun, Sebastian .
NATURE, 2017, 542 (7639) :115-+