CheXseen: Unseen Disease Detection for Deep Learning Interpretation of Chest X-rays

被引:0
作者
Shi, Siyu [1 ]
Malhi, Ishaan [1 ]
Tran, Kevin [1 ]
Ng, Andrew Y. [1 ]
Rajpurkar, Pranav [1 ]
机构
[1] Stanford Univ, Stanford, CA 94305 USA
来源
MEDICAL IMAGING WITH DEEP LEARNING, VOL 143 | 2021年 / 143卷
关键词
Unseen Disease Detection; Deep Learning;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We systematically evaluate the performance of deep learning models in the presence of diseases not labeled for or present during training. First, we evaluate whether deep learning models trained on a subset of diseases (seen diseases) can detect the presence of any one of a larger set of diseases. We find that models tend to falsely classify diseases outside of the subset (unseen diseases) as "no disease". Second, we evaluate whether models trained on seen diseases can detect seen diseases when co-occurring with diseases outside the subset (unseen diseases). We find that models are still able to detect seen diseases even when co-occurring with unseen diseases. Third, we evaluate whether feature representations learned by models may be used to detect the presence of unseen diseases given a small labeled set of unseen diseases. We find that the penultimate layer of the deep neural network provides useful features for unseen disease detection. Our results can inform the safe clinical deployment of deep learning models trained on a non-exhaustive set of disease classes.
引用
收藏
页码:699 / 712
页数:14
相关论文
共 24 条
[1]   How to obtain the P value from a confidence interval [J].
Altman, Douglas G. ;
Bland, J. Martin .
BMJ-BRITISH MEDICAL JOURNAL, 2011, 343
[2]  
[Anonymous], INT C LEARNING REPRE
[3]  
Baiu Ioana, 2019, JAMA, V321, P1836, DOI 10.1001/jama.2019.2313
[4]   Towards Open Set Deep Networks [J].
Bendale, Abhijit ;
Boult, Terrance E. .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :1563-1572
[5]  
Cao Tianshi, 2020, arXiv
[6]   Recent Advances in Open Set Recognition: A Survey [J].
Geng, Chuanxing ;
Huang, Sheng-Jun ;
Chen, Songcan .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2021, 43 (10) :3614-3631
[7]  
Hendrycks D, 2018, Arxiv, DOI arXiv:1610.02136
[8]   Densely Connected Convolutional Networks [J].
Huang, Gao ;
Liu, Zhuang ;
van der Maaten, Laurens ;
Weinberger, Kilian Q. .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :2261-2269
[9]  
Irvin J, 2019, AAAI CONF ARTIF INTE, P590
[10]  
Kingma Diederik P, 2019, Open set medical diagnosis