Super-resolution recurrent convolutional neural networks for learning with multi-resolution whole slide images

被引:11
作者
Mukherjee, Lopamudra [1 ]
Bui, Huu Dat [1 ]
Keikhosravi, Adib [2 ]
Loeffler, Agnes [3 ]
Eliceiri, Kevin W. [2 ,4 ]
机构
[1] Univ Wisconsin, Dept Comp Sci, Whitewater, WI 53190 USA
[2] Univ Wisconsin, Dept Biomed Engn, Madison, WI USA
[3] Metrohlth Med Ctr, Dept Pathol, Cleveland, OH USA
[4] Morgridge Inst Res, Madison, WI USA
关键词
image super-resolution; convolutional neural networks; pathology; whole slide imaging; machine learning; PANCREATIC-CANCER; STROMAL BIOLOGY; DEEP; GRADE; CLASSIFICATION; CARCINOMA; OBJECT;
D O I
10.1117/1.JBO.24.12.126003
中图分类号
Q5 [生物化学];
学科分类号
071010 ; 081704 ;
摘要
We study a problem scenario of super-resolution (SR) algorithms in the context of whole slide imaging (WSI), a popular imaging modality in digital pathology. Instead of just one pair of high- and low-resolution images, which is typically the setup in which SR algorithms are designed, we are given multiple intermediate resolutions of the same image as well. The question remains how to best utilize such data to make the transformation learning problem inherent to SR more tractable and address the unique challenges that arises in this biomedical application. We propose a recurrent convolutional neural network model, to generate SR images from such multi-resolution WSI datasets. Specifically, we show that having such intermediate resolutions is highly effective in making the learning problem easily trainable and address large resolution difference in the low and high-resolution images common in WSI, even without the availability of a large size training data. Experimental results show state-of-the-art performance on three WSI histopathology cancer datasets, across a number of metrics. (C) The Authors. Published by SPIE under a Creative Commons Attribution 4.0 Unported License.
引用
收藏
页数:15
相关论文
共 72 条
  • [1] Anden J., 2011, ISMIR, P657
  • [2] Collagen organization of renal cell carcinoma differs between low and high grade tumors
    Best, Sara L.
    Liu, Yuming
    Keikhosravi, Adib
    Drifka, Cole R.
    Woo, Kaitlin M.
    Mehta, Guneet S.
    Altwegg, Marie
    Thimm, Terra N.
    Houlihan, Matthew
    Bredfeldt, Jeremy S.
    Abel, E. Jason
    Huang, Wei
    Eliceiri, Kevin W.
    [J]. BMC CANCER, 2019, 19 (1)
  • [3] Bunker N. S., 1996, US Patent, Patent No. [5,525,984, 5525984]
  • [4] Real-Time Video Super-Resolution with Spatio-Temporal Networks and Motion Compensation
    Caballero, Jose
    Ledig, Christian
    Aitken, Andrew
    Acosta, Alejandro
    Totz, Johannes
    Wang, Zehan
    Shi, Wenzhe
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 2848 - 2857
  • [5] PCANet: A Simple Deep Learning Baseline for Image Classification?
    Chan, Tsung-Han
    Jia, Kui
    Gao, Shenghua
    Lu, Jiwen
    Zeng, Zinan
    Ma, Yi
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2015, 24 (12) : 5017 - 5032
  • [6] Trainable Nonlinear Reaction Diffusion: A Flexible Framework for Fast and Effective Image Restoration
    Chen, Yunjin
    Pock, Thomas
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (06) : 1256 - 1272
  • [7] Aligned Collagen Is a Prognostic Signature for Survival in Human Breast Carcinoma
    Conklin, Matthew W.
    Eickhoff, Jens C.
    Riching, Kristin M.
    Pehlke, Carolyn A.
    Eliceiri, Kevin W.
    Provenzano, Paolo P.
    Friedl, Andreas
    Keely, Patricia J.
    [J]. AMERICAN JOURNAL OF PATHOLOGY, 2011, 178 (03) : 1221 - 1232
  • [8] Cui Z, 2014, LECT NOTES COMPUT SC, V8693, P49, DOI 10.1007/978-3-319-10602-1_4
  • [9] Image quality assessment based on a degradation model
    Damera-Venkata, N
    Kite, TD
    Geisler, WS
    Evans, BL
    Bovik, AC
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2000, 9 (04) : 636 - 650
  • [10] Deng J, 2009, PROC CVPR IEEE, P248, DOI 10.1109/CVPRW.2009.5206848