Dual attention multiple instance learning with unsupervised complementary loss for COVID-19 screening

被引:37
作者
Chikontwe, Philip [1 ]
Luna, Miguel [1 ]
Kang, Myeongkyun [1 ]
Hong, Kyung Soo [2 ]
Ahn, June Hong [2 ]
Park, Sang Hyun [1 ]
机构
[1] Daegu Gyeongbuk Inst Sci & Technol DGIST, Dept Robot Engn, Daegu, South Korea
[2] Yeungnam Univ, Yeungnam Univ Med Ctr, Coll Med, Reg Ctr Resp Dis,Div Pulmonol & Allergy,Dept Inte, Daegu, South Korea
基金
新加坡国家研究基金会;
关键词
COVID-19; CT images; Deep learning; Multiple instance learning; Unsupervised complementary loss; DEEP; CLASSIFICATION; DIAGNOSIS; ROBUST;
D O I
10.1016/j.media.2021.102105
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Chest computed tomography (CT) based analysis and diagnosis of the Coronavirus Disease 2019 (COVID19) plays a key role in combating the outbreak of the pandemic that has rapidly spread worldwide. To date, the disease has infected more than 18 million people with over 690k deaths reported. Reverse transcription polymerase chain reaction (RT-PCR) is the current gold standard for clinical diagnosis but may produce false positives; thus, chest CT based diagnosis is considered more viable. However, accurate screening is challenging due to the difficulty in annotation of infected areas, curation of large datasets, and the slight discrepancies between COVID-19 and other viral pneumonia. In this study, we propose an attention-based end-to-end weakly supervised framework for the rapid diagnosis of COVID-19 and bacterial pneumonia based on multiple instance learning (MIL). We further incorporate unsupervised contrastive learning for improved accuracy with attention applied both in spatial and latent contexts, herein we propose Dual Attention Contrastive based MIL (DA-CMIL). DA-CMIL takes as input several patient CT slices (considered as bag of instances) and outputs a single label. Attention based pooling is applied to implicitly select key slices in the latent space, whereas spatial attention learns slice spatial context for interpretable diagnosis. A contrastive loss is applied at the instance level to encode similarity of features from the same patient against representative pooled patient features. Empirical results show that our algorithm achieves an overall accuracy of 98.6% and an AUC of 98.4%. Moreover, ablation studies show the benefit of contrastive learning with MIL. (c) 2021 Elsevier B.V. All rights reserved.
引用
收藏
页数:12
相关论文
共 49 条
[1]   Decoding tumour phenotype by noninvasive imaging using a quantitative radiomics approach [J].
Aerts, Hugo J. W. L. ;
Velazquez, Emmanuel Rios ;
Leijenaar, Ralph T. H. ;
Parmar, Chintan ;
Grossmann, Patrick ;
Cavalho, Sara ;
Bussink, Johan ;
Monshouwer, Rene ;
Haibe-Kains, Benjamin ;
Rietveld, Derek ;
Hoebers, Frank ;
Rietbergen, Michelle M. ;
Leemans, C. Rene ;
Dekker, Andre ;
Quackenbush, John ;
Gillies, Robert J. ;
Lambin, Philippe .
NATURE COMMUNICATIONS, 2014, 5
[2]   Correlation of Chest CT and RT-PCR Testing for Coronavirus Disease 2019 (COVID-19) in China: A Report of 1014 Cases [J].
Ai, Tao ;
Yang, Zhenlu ;
Hou, Hongyan ;
Zhan, Chenao ;
Chen, Chong ;
Lv, Wenzhi ;
Tao, Qian ;
Sun, Ziyong ;
Xia, Liming .
RADIOLOGY, 2020, 296 (02) :E32-E40
[3]  
Alom M. Z., 2020, COVID_MTNet: COVID-19 detec- tion with multi -task deep learning approaches, DOI DOI 10.48550/ARXIV.2004.03747
[4]   Clinical-grade computational pathology using weakly supervised deep learning on whole slide images [J].
Campanella, Gabriele ;
Hanna, Matthew G. ;
Geneslaw, Luke ;
Miraflor, Allen ;
Silva, Vitor Werneck Krauss ;
Busam, Klaus J. ;
Brogi, Edi ;
Reuter, Victor E. ;
Klimstra, David S. ;
Fuchs, Thomas J. .
NATURE MEDICINE, 2019, 25 (08) :1301-+
[5]   Multiple instance learning: A survey of problem characteristics and applications [J].
Carbonneau, Marc-Andre ;
Cheplygina, Veronika ;
Granger, Eric ;
Gagnon, Ghyslain .
PATTERN RECOGNITION, 2018, 77 :329-353
[6]  
Chen Ting, 2019, 25 AMERICAS C INFORM
[7]   Ferroptosis: machinery and regulation [J].
Chen, Xin ;
Li, Jingbo ;
Kang, Rui ;
Klionsky, Daniel J. ;
Tang, Daolin .
AUTOPHAGY, 2021, 17 (09) :2054-2081
[8]  
Chikontwe Philip, 2020, Medical Image Computing and Computer Assisted Intervention - MICCAI 2020. 23rd International Conference. Proceedings. Lecture Notes in Computer Science (LNCS 12265), P519, DOI 10.1007/978-3-030-59722-1_50
[9]  
Dauphin YN, 2017, PR MACH LEARN RES, V70
[10]  
Feng J, 2017, AAAI CONF ARTIF INTE, P1884