Performance of Qure.ai automatic classifiers against a large annotated database of patients with diverse forms of tuberculosis

被引:23
作者
Engle, Eric [1 ]
Gabrielian, Andrei [1 ]
Long, Alyssa [1 ]
Hurt, Darrell E. [1 ]
Rosenthal, Alex [1 ]
机构
[1] NIAID, Off Cyber Infrastruct & Computat Biol, NIH, 9000 Rockville Pike, Bethesda, MD 20892 USA
来源
PLOS ONE | 2020年 / 15卷 / 01期
关键词
D O I
10.1371/journal.pone.0224445
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Availability of trained radiologists for fast processing of CXRs in regions burdened with tuberculosis always has been a challenge, affecting both timely diagnosis and patient monitoring. The paucity of annotated images of lungs of TB patients hampers attempts to apply data-oriented algorithms for research and clinical practices. The TB Portals Program database (TBPP, https://TBPortals.niaid.nih.gov) is a global collaboration curating a large collection of the most dangerous, hard-to-cure drug-resistant tuberculosis (DR-TB) patient cases. TBPP, with 1,179 (83%) DR-TB patient cases, is a unique collection that is well positioned as a testing ground for deep learning classifiers. As of January 2019, the TBPP database contains 1,538 CXRs, of which 346 (22.5%) are annotated by a radiologist and 104 (6.7%) by a pulmonologist-leaving 1,088 (70.7%) CXRs without annotations. The Qure.ai qXR artificial intelligence automated CXR interpretation tool, was blind-tested on the 346 radiologist-annotated CXRs from the TBPP database. Qure.ai qXR CXR predictions for cavity, nodule, pleural effusion, hilar lymphadenopathy was successfully matching human expert annotations. In addition, we tested the 12 Qure.ai classifiers to find whether they correlate with treatment success (information provided by treating physicians). Ten descriptors were found as significant: abnormal CXR (p = 0.0005), pleural effusion (p = 0.048), nodule (p = 0.0004), hilar lymphadenopathy (p = 0.0038), cavity (p = 0.0002), opacity (p = 0.0006), atelectasis (p = 0.0074), consolidation (p = 0.0004), indicator of TB disease (p = <.0001), and fibrosis (p = <.0001). We conclude that applying fully automated Qure.ai CXR analysis tool is useful for fast, accurate, uniform, large-scale CXR annotation assistance, as it performed well even for DR-TB cases that were not used for initial training. Testing artificial intelligence algorithms (encapsulating both machine learning and deep learning classifiers) on diverse data collections, such as TBPP, is critically important toward progressing to clinically adopted automatic assistants for medical data analysis.
引用
收藏
页数:19
相关论文
共 36 条
  • [1] [Anonymous], 2019, ARXIV190107031
  • [2] [Anonymous], 2013, SYST SCREEN ACT TUB
  • [3] [Anonymous], The Economist
  • [4] [Anonymous], 2003, RADIOLOGIST SIGHTING
  • [5] [Anonymous], 2017, IEEE CVPR
  • [6] [Anonymous], WHO Global Tuberculosis Programme
  • [7] DeVries G, 2018, 49 UN WORLD C OCT HA
  • [8] Dorman SE, 2018, LANCET INFECT DIS, V18, P76, DOI [10.1016/s1473-3099(17)30691-6, 10.1016/S1473-3099(17)30691-6]
  • [9] Assessment of Convolutional Neural Networks for Automated Classification of Chest Radiographs
    Dunnmon, Jared A.
    Yi, Darvin
    Langlotz, Curtis P.
    Re, Christopher
    Rubin, Daniel L.
    Lungren, Matthew P.
    [J]. RADIOLOGY, 2019, 290 (02) : 537 - 544
  • [10] European Society of Radiology (ESR) and American College of Radiology (ACR) report of the 2015 global summit on radiological quality and safety
    European Society of Radiology
    American College of Radiology
    [J]. INSIGHTS INTO IMAGING, 2016, 7 (04): : 481 - 484