Deep Interpretable Classification and Weakly-Supervised Segmentation of Histology Images via Max-Min Uncertainty

被引:30
作者
Belharbi, Soufiane [1 ]
Rony, Jerome [1 ]
Dolz, Jose [2 ]
Ben Ayed, Ismail [1 ]
Mccaffrey, Luke [3 ]
Granger, Eric [1 ]
机构
[1] Ecole Technol Super ETS, Dept Syst Engn, Lab Imagerie Vis & Intelligence Artificielle LIVI, Montreal, PQ H3C 1K3, Canada
[2] Ecole Technol Super ETS, Dept Comp Engn, Lab Imagerie Vis & Intelligence Artificielle LIVI, Montreal, PQ H3C 1K3, Canada
[3] McGill Univ, Rosalind & Morris Goodman Canc Inst, Gerald Bronfman Dept Oncol, Montreal, PQ H3A 0G4, Canada
基金
加拿大自然科学与工程研究理事会;
关键词
Image segmentation; Uncertainty; Histopathology; Predictive models; Standards; Training; Solid modeling; Deep weakly-supervised learning; image classification; semantic segmentation; histology images; interpretability; CONVOLUTIONAL NETWORKS;
D O I
10.1109/TMI.2021.3123461
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Weakly-supervised learning (WSL) has recently triggered substantial interest as it mitigates the lack of pixel-wise annotations. Given global image labels, WSL methods yield pixel-level predictions (segmentations), which enable to interpret class predictions. Despite their recent success, mostly with natural images, such methods can face important challenges when the foreground and background regions have similar visual cues, yielding high false-positive rates in segmentations, as is the case in challenging histology images. WSL training is commonly driven by standard classification losses, which implicitly maximize model confidence, and locate the discriminative regions linked to classification decisions. Therefore, they lack mechanisms for modeling explicitly non-discriminative regions and reducing false-positive rates. We propose novel regularization terms, which enable the model to seek both non-discriminative and discriminative regions, while discouraging unbalanced segmentations. We introduce high uncertainty as a criterion to localize non-discriminative regions that do not affect classifier decision, and describe it with original Kullback-Leibler (KL) divergence losses evaluating the deviation of posterior predictions from the uniform distribution. Our KL terms encourage high uncertainty of the model when the latter inputs the latent non-discriminative regions. Our loss integrates: (i) a cross-entropy seeking a foreground, where model confidence about class prediction is high; (ii) a KL regularizer seeking a background, where model uncertainty is high; and (iii) log-barrier terms discouraging unbalanced segmentations. Comprehensive experiments and ablation studies over the public GlaS colon cancer data and a Camelyon16 patch-based benchmark for breast cancer show substantial improvements over state-of-the-art WSL methods, and confirm the effect of our new regularizers (our code is publicly available at https://github.com/sbelharbi/deep-wsl-histo-min-max-uncertainty).
引用
收藏
页码:702 / 714
页数:13
相关论文
共 89 条
[1]  
[Anonymous], 2017, IEEE I CONF COMP VIS, DOI [10.1109/ICCV.2017.382, DOI 10.1109/ICCV.2017.382]
[2]   On Pixel-Wise Explanations for Non-Linear Classifier Decisions by Layer-Wise Relevance Propagation [J].
Bach, Sebastian ;
Binder, Alexander ;
Montavon, Gregoire ;
Klauschen, Frederick ;
Mueller, Klaus-Robert ;
Samek, Wojciech .
PLOS ONE, 2015, 10 (07)
[3]   Constrained Domain Adaptation for Segmentation [J].
Bateson, Mathilde ;
Kervadec, Hoel ;
Dolz, Jose ;
Lombaert, Herve ;
Ben Ayed, Ismail .
MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2019, PT II, 2019, 11765 :326-334
[4]   Network Dissection: Quantifying Interpretability of Deep Visual Representations [J].
Bau, David ;
Zhou, Bolei ;
Khosla, Aditya ;
Oliva, Aude ;
Torralba, Antonio .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :3319-3327
[5]   What's the Point: Semantic Segmentation with Point Supervision [J].
Bearman, Amy ;
Russakovsky, Olga ;
Ferrari, Vittorio ;
Fei-Fei, Li .
COMPUTER VISION - ECCV 2016, PT VII, 2016, 9911 :549-565
[6]   Diagnostic Assessment of Deep Learning Algorithms for Detection of Lymph Node Metastases in Women With Breast Cancer [J].
Bejnordi, Babak Ehteshami ;
Veta, Mitko ;
van Diest, Paul Johannes ;
van Ginneken, Bram ;
Karssemeijer, Nico ;
Litjens, Geert ;
van der Laak, Jeroen A. W. M. .
JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION, 2017, 318 (22) :2199-2210
[7]  
Belharbi S., 2019, ARXIV191110720
[8]  
Belharbi S., 2022, P IEEE CVF WINT C AP, P3490
[9]   Deep Active Learning for Joint Classification & Segmentation with Weak Annotator [J].
Belharbi, Soufiane ;
Ben Ayed, Ismail ;
McCaffrey, Luke ;
Granger, Eric .
2021 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION WACV 2021, 2021, :3337-3346
[10]  
Berthelot D, 2019, ADV NEUR IN, V32