Deep-Supervised Adversarial Learning-based Classification For Digital Histologic Images

被引:0
作者
Wang, Zhimin [1 ]
Fan, Zong [2 ]
Sun, Lulu [3 ]
Hao, Yao [4 ]
Gay, Hiram A. [4 ]
Thorstad, Wade L. [4 ]
Wang, Xiaowei [5 ]
Li, Hua [2 ,4 ,6 ]
机构
[1] Univ Illinois, Dept Elect & Comput Eng, Urbana, IL USA
[2] Univ Illinois, Dept Bioengn, Urbana, IL 61820 USA
[3] Washington Univ, Dept Pathol & Immunol, St Louis, MO USA
[4] Washington Univ, Dept Radiat Oncol, St Louis, MO 63110 USA
[5] Univ Illinois, Dept Pharmacol & Bioeng, Chicago, IL USA
[6] Canc Ctr Illinois, Urbana, IL 61801 USA
来源
MEDICAL IMAGING 2023 | 2023年 / 12471卷
关键词
Deep learning-based classification; Digital Pathology; Whole Slide Images; Generative Adversarial Network;
D O I
10.1117/12.2654402
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
High-resolution histopathological images have rich characteristics of cancer tissues and cells. Recent studies have shown that digital pathology analysis can aid clinical decision-making by identifying metastases, subtyping and grading tumors, and predicting clinical outcomes. Still, the analysis of digital histologic images remains challenging due to the imbalance of the training data, the intrinsic complexity of histology characteristics of tumor tissue, and the extremely heavy computation burden for processing extremely high-resolution whole slide imaging (WSI) images. In this study, we developed a new deep learning-based classification framework that addresses these unique challenges to support clinical decision-making. The proposed method is motivated by our recently developed adversarial learning strategy with two major innovations. First, an image pre-processing module was designed to process the high-resolution histology images to reduce computational burden and keep informative features, alleviating the risk of overfitting issues when training the network. Second, recently developed StyleGAN2 with powerful generative capability was employed to recognize complex texture patterns and stain information in histology images and learn deep classification-relevant information, further improving the classification and reconstruction performance of our method. The experimental results on three different histology image datasets for different classification tasks demonstrated superior classification performance compared to traditional deep learning-based methods, and the generality of the proposed method to be applied to various applications.
引用
收藏
页数:11
相关论文
共 31 条
[1]  
BORST MJ, 1993, SURGERY, V114, P637
[2]   Scaling Vision Transformers to Gigapixel Images via Hierarchical Self-Supervised Learning [J].
Chen, Richard J. ;
Chen, Chengkuan ;
Li, Yicong ;
Chen, Tiffany Y. ;
Trister, Andrew D. ;
Krishnan, Rahul G. ;
Mahmood, Faisal .
2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, :16123-16134
[3]   Classification and mutation prediction from non-small cell lung cancer histopathology images using deep learning [J].
Coudray, Nicolas ;
Ocampo, Paolo Santiago ;
Sakellaropoulos, Theodore ;
Narula, Navneet ;
Snuderl, Matija ;
Fenyo, David ;
Moreira, Andre L. ;
Razavian, Narges ;
Tsirigos, Aristotelis .
NATURE MEDICINE, 2018, 24 (10) :1559-+
[4]  
Daroach G. B., 2022, MEDICAL IMAGE COMPUT
[5]  
Fan Z., 2021, SPIE, V11598, P286
[6]   Whole slide imaging in pathology: advantages, limitations, and emerging perspectives [J].
Farahani, Navid ;
Parwani, Anil V. ;
Pantanowitz, Liron .
PATHOLOGY AND LABORATORY MEDICINE INTERNATIONAL, 2015, 7 :23-33
[7]   Deep learning trained on hematoxylin and eosin tumor region of Interest predicts HER2 status and trastuzumab treatment response in HER2+breast cancer [J].
Farahmand, Saman ;
Fernandez, Aileen, I ;
Ahmed, Fahad Shabbir ;
Rimm, David L. ;
Chuang, Jeffrey H. ;
Reisenbichler, Emily ;
Zarringhalam, Kourosh .
MODERN PATHOLOGY, 2022, 35 (01) :44-51
[8]   Digital Imaging in Pathology: Whole-Slide Imaging and Beyond [J].
Ghaznavi, Farzad ;
Evans, Andrew ;
Madabhushi, Anant ;
Feldman, Michael .
ANNUAL REVIEW OF PATHOLOGY: MECHANISMS OF DISEASE, VOL 8, 2013, 8 :331-359
[9]  
Glorot X, 2010, P 13 INT C ART INT S, P249
[10]  
Goodfellow IJ, 2014, ADV NEUR IN, V27, P2672