Code and Data Sharing Practices in the Radiology Artificial Intelligence Literature: A Meta-Research Study

被引：20

作者：

Venkatesh, Kesavan ^{[1
,2
]}

Santomartino, Samantha M. ^{[2
]}

Sulam, Jeremias ^{[1
]}

Yi, Paul H. ^{[2
]}

机构：

[1] Johns Hopkins Univ, Dept Biomed Engn, Baltimore, MD USA

[2] Univ Maryland, Univ Maryland Med Intelligent Imaging UM2ii Ctr, Dept Radiol & Nucl Med, Sch Med, 670 W Baltimore St,First Floor,Room 1172, Baltimore, MD 21201 USA

来源：

RADIOLOGY-ARTIFICIAL INTELLIGENCE | 2022年 / 4卷 / 05期

关键词：

Meta-Analysis; AI in Education; Machine Learning;

D O I：

10.1148/ryai.220081

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

Purpose: To evaluate code and data sharing practices in original artificial intelligence (AI) scientific manuscripts published in the Radiological Society of North America (RSNA) journals suite from 2017 through 2021. Materials and Methods: A retrospective meta-research study was conducted of articles published in the RSNA journals suite from January 1, 2017, through December 31, 2021. A total of 218 articles were included and evaluated for code sharing practices, reproducibility of shared code, and data sharing practices. Categorical comparisons were conducted using Fisher exact tests with respect to year and journal of publication, author affiliation(s), and type of algorithm used. Results: Of the 218 included articles, 73 (34%) shared code, with 24 (33% of code sharing articles and 11% of all articles) sharing reproducible code. Radiology and Radiology: Artificial Intelligence published the most code sharing articles (48 [66%] and 21 [29%], respectively). Twenty-nine articles (13%) shared data, and 12 of these articles (41% of data sharing articles) shared complete experimental data by using only public domain datasets. Four of the 218 articles (2%) shared both code and complete experimental data. Code sharing rates were statistically higher in 2020 and 2021 compared with earlier years (P < .01) and were higher in Radiology and Radiology: Artificial Intelligence compared with other journals (P < .01). Conclusion: Original AI scientific articles in the RSNA journals suite had low rates of code and data sharing, emphasizing the need for open-source code and data to achieve transparent and reproducible science.

引用

页数：6

共 23 条

[1]

Phillips NA, 2020, Arxiv, DOI arXiv:2007.06199

[2]

aapm, MED PHYS

[3] Assessing Radiology Research on Artificial Intelligence: A Brief Guide for Authors, Reviewers, and Readers-From the Radiology Editorial Board [J].

Bluemke, David A. ;

Moy, Linda ;

Bredella, Miriam A. ;

Ertl-Wagner, Birgit B. ;

Fowler, Kathryn J. ;

Goh, Vicky J. ;

Halpern, Elkan F. ;

Hess, Christopher P. ;

Schiebler, Mark L. ;

Weiss, Clifford R. .

RADIOLOGY, 2020, 294 (03) :487-489

[4] PadChest: A large chest x-ray image dataset with multi-label annotated reports [J].

Bustos, Aurelia ;

Pertusa, Antonio ;

Salinas, Jose-Maria ;

de la Iglesia-Vaya, Maria .

MEDICAL IMAGE ANALYSIS, 2020, 66

[5] Magician's Corner: How to Start Learning about Deep Learning [J].

Erickson, Bradley J. .

RADIOLOGY-ARTIFICIAL INTELLIGENCE, 2019, 1 (04)

[6]

github, Tips for publishing research code

[7]

Gundersen OE, 2018, AAAI CONF ARTIF INTE, P1644

[8]

IEEE Xplore, IEEE T MED IM WEBS

[9]

Irvin J, 2019, Arxiv, DOI [arXiv:1901.07031, DOI 10.48550/ARXIV.1901.07031, DOI 10.1609/AAAI.V33I01.3301590]

[10] MIMIC-CXR, a de-identified publicly available database of chest radiographs with free-text reports [J].

Johnson, Alistair E. W. ;

Pollard, Tom J. ;

Berkowitz, Seth J. ;

Greenbaum, Nathaniel R. ;

Lungren, Matthew P. ;

Deng, Chih-ying ;

Mark, Roger G. ;

Horng, Steven .

SCIENTIFIC DATA, 2019, 6 (1)

← 1 2 3 →