Independent evaluation of 12 artificial intelligence solutions for the detection of tuberculosis

被引：56

作者：

Codlin, Andrew J. ^{[1
]}

Thang Phuoc Dao ^{[2
]}

Luan Nguyen Quang Vo ^{[1
,2
]}

Forse, Rachel J. ^{[1
,3
]}

Vinh Van Truong ^{[4
]}

Ha Minh Dang ^{[4
]}

Lan Huu Nguyen ^{[4
]}

Hoa Binh Nguyen ^{[5
]}

Nhung Viet Nguyen ^{[5
]}

Sidney-Annerstedt, Kristi ^{[3
]}

Squire, Bertie ^{[6
]}

Lonnroth, Knut ^{[3
]}

Caws, Maxine ^{[6
,7
]}

机构：

[1] Friends Int TB Relief FIT, Ho Chi Minh City, Vietnam

[2] IRD VN, Ho Chi Minh City, Vietnam

[3] Karolinska Inst, WHO Collaborat Ctr TB & Social Med, Dept Global Publ Hlth, Solna, Sweden

[4] Pham Ngoc Thach Hosp, Ho Chi Minh City, Vietnam

[5] Natl Lung Hosp, Hanoi, Vietnam

[6] Liverpool Sch Trop Med LSTM, Dept Clin Sci, Liverpool, Merseyside, England

[7] Birat Nepal Med Trust, Kathmandu, Nepal

来源：

SCIENTIFIC REPORTS | 2021年 / 11卷 / 01期

基金：

欧盟地平线“2020”;

关键词：

CHEST RADIOGRAPHY; PULMONARY TUBERCULOSIS;

D O I：

10.1038/s41598-021-03265-0

中图分类号：

O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];

学科分类号：

07 ; 0710 ; 09 ;

摘要：

There have been few independent evaluations of computer-aided detection (CAD) software for tuberculosis (TB) screening, despite the rapidly expanding array of available CAD solutions. We developed a test library of chest X-ray (CXR) images which was blindly re-read by two TB clinicians with different levels of experience and then processed by 12 CAD software solutions. Using Xpert MTB/RIF results as the reference standard, we compared the performance characteristics of each CAD software against both an Expert and Intermediate Reader, using cut-off thresholds which were selected to match the sensitivity of each human reader. Six CAD systems performed on par with the Expert Reader (Qure.ai, DeepTek, Delft Imaging, JF Healthcare, OXIPIT, and Lunit) and one additional software (Infervision) performed on par with the Intermediate Reader only. Qure.ai, Delft Imaging and Lunit were the only software to perform significantly better than the Intermediate Reader. The majority of these CAD software showed significantly lower performance among participants with a past history of TB. The radiography equipment used to capture the CXR image was also shown to affect performance for some CAD software. TB program implementers now have a wide selection of quality CAD software solutions to utilize in their CXR screening initiatives.

引用

页数：11

共 49 条

[11] Artificial Intelligence (AI): Multidisciplinary perspectives on emerging challenges, opportunities, and agenda for research, practice and policy [J].

Dwivedi, Yogesh K. ;

Hughes, Laurie ;

Ismagilova, Elvira ;

Aarts, Gert ;

Coombs, Crispin ;

Crick, Tom ;

Duan, Yanqing ;

Dwivedi, Rohita ;

Edwards, John ;

Eirug, Aled ;

Galanos, Vassilis ;

Ilavarasan, P. Vigneswara ;

Janssen, Marijn ;

Jones, Paul ;

Kar, Arpan Kumar ;

Kizgin, Hatice ;

Kronemann, Bianca ;

Lal, Banita ;

Lucini, Biagio ;

Medaglia, Rony ;

Le Meunier-FitzHugh, Kenneth ;

Le Meunier-FitzHugh, Leslie Caroline ;

Misra, Santosh ;

Mogaji, Emmanuel ;

Sharma, Sujeet Kumar ;

Singh, Jang Bahadur ;

Raghavan, Vishnupriya ;

Raman, Ramakrishnan ;

Rana, Nripendra P. ;

Samothrakis, Spyridon ;

Spencer, Jak ;

Tamilmani, Kuttimani ;

Tubadji, Annie ;

Walton, Paul ;

Williams, Michael D. .

INTERNATIONAL JOURNAL OF INFORMATION MANAGEMENT, 2021, 57

[12] Software licensing models: What's out there? [J].

Ferrante, Daniel .

IT Professional, 2006, 8 (06) :24-29

[13]

Foundation for Innovative New Diagnostics, 2021, Digital Chest Radiography and Computer -Aided Detection (CAD) solutions for Tuberculosis Diagnostics Technology Landscape Analysis

[14] Subclinical Tuberculosis Disease-A Review and Analysis of Prevalence Surveys to Inform Definitions, Burden, Associations, and Screening Methodology [J].

Frascella, Beatrice ;

Richards, Alexandra S. ;

Sossen, Bianca ;

Emery, Jon C. ;

Odone, Anna ;

Law, Irwin ;

Onozaki, Ikushi ;

Esmail, Hanif ;

Houben, Rein M. G. J. .

CLINICAL INFECTIOUS DISEASES, 2021, 73 (03) :E830-E841

[15] The second national tuberculosis prevalence survey in Vietnam [J].

Hai Viet Nguyen ;

Tiemersma, Edine W. ;

Hoa Binh Nguyen ;

Cobelens, Frank G. J. ;

Finlay, Alyssa ;

Glaziou, Philippe ;

Cu Huy Dao ;

Mirtskhulava, Veriko ;

Hung Van Nguyen ;

Pham, Huyen T. T. ;

Khieu, Ngoc T. T. ;

de Haas, Petra ;

Nam Hoang Do ;

Phan Do Nguyen ;

Cong Van Cung ;

Nhung Viet Nguyen .

PLOS ONE, 2020, 15 (04)

[16] A systematic review of the diagnostic accuracy of artificial intelligence-based computer programs to analyze chest x-rays for pulmonary tuberculosis [J].

Harris, Miriam ;

Qi, Amy ;

Jeagal, Luke ;

Torabi, Nazi ;

Menzies, Dick ;

Korobitsyn, Alexei ;

Pai, Madhukar ;

Nathavitharana, Ruvandhi R. ;

Khan, Faiz Ahmad .

PLOS ONE, 2019, 14 (09)

[17] Xpert MTB/RIF and Xpert MTB/RIF Ultra for pulmonary tuberculosis and rifampicin resistance in adults [J].

Horne, David J. ;

Kohli, Mikashmi ;

Zifodya, Jerry S. ;

Schiller, Ian ;

Dendukuri, Nandini ;

Tollefson, Deanna ;

Schumacher, Samuel G. ;

Ochodo, Eleanor A. ;

Pai, Madhukar ;

Steingart, Karen R. .

COCHRANE DATABASE OF SYSTEMATIC REVIEWS, 2019, (06)

[18]

Khan FA, 2020, LANCET DIGIT HEALTH, V2, pE573, DOI 10.1016/S2589-7500(20)30221-1

[19] Evaluation of a chest radiograph reading and recording system for tuberculosis in a HIV-positive cohort [J].

Kosack, C. S. ;

Spijker, S. ;

Halton, J. ;

Bonnet, M. ;

Nicholas, S. ;

Chetcuti, K. ;

Mesic, A. ;

Brant, W. E. ;

Joekes, E. ;

Andronikou, S. .

CLINICAL RADIOLOGY, 2017, 72 (06) :519.e1-519.e9

[20] Artificial Intelligence, Radiology, and Tuberculosis: A Review [J].

Kulkarni, Sagar ;

Jha, Saurabh .

ACADEMIC RADIOLOGY, 2020, 27 (01) :71-75

← 1 2 3 4 5 →