Artificial intelligence based liver portal tract region identification and quantification with transplant biopsy whole-slide images

被引:11
作者
Yu, Hanyi [1 ]
Sharifai, Nima [2 ]
Jiang, Kun [3 ]
Wang, Fusheng [4 ,5 ]
Teodoro, George [6 ]
Farris, Alton B. [7 ]
Kong, Jun [1 ,8 ,9 ]
机构
[1] Emory Univ, Dept Comp Sci, Atlanta, GA 30322 USA
[2] Univ Maryland, Dept Pathol, Sch Med, Baltimore, MD 21201 USA
[3] H Lee Moffitt Canc Ctr & Res Inst, Dept Pathol, Tampa, FL 33612 USA
[4] SUNY Stony Brook, Dept Comp Sci, Stony Brook, NY 11794 USA
[5] SUNY Stony Brook, Dept Biomed Informat, Stony Brook, NY 11794 USA
[6] Univ Fed Minas Gerais, Dept Comp Sci, BR-31270 Belo Horizonte, MG, Brazil
[7] Emory Univ, Dept Pathol & Lab Med, Atlanta, GA 30322 USA
[8] Georgia State Univ, Dept Math & Stat, Atlanta, GA 30303 USA
[9] Emory Univ, Winship Canc Inst, Atlanta, GA 30322 USA
基金
美国国家科学基金会;
关键词
Deep learning; Image segmentation; Liver portal tract; Liver fibrosis staging; Attention mechanism; COLOR NORMALIZATION; SEGMENTATION; FIBROSIS; CLASSIFICATION; NETWORKS; MODEL; UNET;
D O I
10.1016/j.compbiomed.2022.106089
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
Liver fibrosis staging is clinically important for liver disease progression prediction. As the portal tract fibrotic quantity and size in a liver biopsy correlate with the fibrosis stage, an accurate analysis of portal tract regions is clinically critical. Manual annotations of portal tract regions, however, are time-consuming and subject to large inter-and intra-observer variability. To address such a challenge, we develop a Multiple Up-sampling and Spatial Attention guided UNet model (MUSA-UNet) to segment liver portal tract regions in whole-slide images of liver tissue slides. To enhance the segmentation performance, we propose to use depth-wise separable convolution, the spatial attention mechanism, the residual connection, and multiple up-sampling paths in the developed model. This study includes 53 histopathology whole slide images from patients who received liver transplantation. In total, 6,012 patches derived from 30 images are used for our deep learning model training and validation. The remaining 23 whole slide images are utilized for the model testing. The average liver portal tract segmentation performance of the developed MUSA-UNet is 0.94 (Precision), 0.85 (Recall), 0.89 (F1 Score), 0.89 (Accuracy), 0.80 (Jaccard Index), and 0.91 (Fowlkes-Mallows Index), respectively. The clinical Scheuer fibrosis stage presents a strong correlation with the resulting average portal tract fibrotic area (R = 0.681, p < 0.001) and portal tract percentage (R = 0.335, p = 0.02) computed from the MUSA-UNet segmentation results. In conclusion, our developed deep learning model MUSA-UNet can accurately segment portal tract regions from whole-slide images of liver tissue biopsies, presenting its promising potential to assist liver disease diagnosis in a computational manner.
引用
收藏
页数:14
相关论文
共 50 条
[1]   A State-of-the-Art Survey on Deep Learning Theory and Architectures [J].
Alom, Md Zahangir ;
Taha, Tarek M. ;
Yakopcic, Chris ;
Westberg, Stefan ;
Sidike, Paheding ;
Nasrin, Mst Shamima ;
Hasan, Mahmudul ;
Van Essen, Brian C. ;
Awwal, Abdul A. S. ;
Asari, Vijayan K. .
ELECTRONICS, 2019, 8 (03)
[2]  
[Anonymous], 2020, PLOS ONE
[3]   Staining Correction in Digital Pathology by Utilizing a Dye Amount Table [J].
Bautista, Pinky A. ;
Yagi, Yukako .
JOURNAL OF DIGITAL IMAGING, 2015, 28 (03) :283-294
[4]  
Bautista Pinky A, 2014, J Pathol Inform, V5, P4, DOI 10.4103/2153-3539.126153
[5]   Quantitative analysis of stain variability in histology slides and an algorithm for standardization [J].
Bejnordi, Babak Ehteshami ;
Timofeeva, Nadya ;
Otte-Hoeller, Irene ;
Karssemeijer, Nico ;
van der Laak, Jeroen A. W. M. .
MEDICAL IMAGING 2014: DIGITAL PATHOLOGY, 2014, 9041
[6]   Stacked fully convolutional networks with multi-channel learning: application to medical image segmentation [J].
Bi, Lei ;
Kim, Jinman ;
Kumar, Ashnil ;
Fulham, Michael ;
Feng, Dagan .
VISUAL COMPUTER, 2017, 33 (6-8) :1061-1071
[7]   Dense-UNet: a novel multiphoton in vivo cellular image segmentation model based on a convolutional neural network [J].
Cai, Sijing ;
Tian, Yunxian ;
Lui, Harvey ;
Zeng, Haishan ;
Wu, Yi ;
Chen, Guannan .
QUANTITATIVE IMAGING IN MEDICINE AND SURGERY, 2020, 10 (06) :1275-1285
[8]  
Chen LC., 2017, RETHINKING ATROUS CO, DOI DOI 10.48550/ARXIV.1706.05587
[9]   DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs [J].
Chen, Liang-Chieh ;
Papandreou, George ;
Kokkinos, Iasonas ;
Murphy, Kevin ;
Yuille, Alan L. .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (04) :834-848
[10]   Machine-learning-based classification of real-time tissue elastography for hepatic fibrosis in patients with chronic hepatitis B [J].
Chen, Yang ;
Luo, Yan ;
Huang, Wei ;
Hu, Die ;
Zheng, Rong-qin ;
Gong, Shu-zhen ;
Meng, Fan-kun ;
Yang, Hong ;
Lin, Hong-jun ;
Sun, Yan ;
Wang, Xiu-yan ;
Wu, Tao ;
Ren, Jie ;
Pei, Shu-Fang ;
Zheng, Ying ;
He, Yun ;
Hu, Yu ;
Yang, Na ;
Yan, Hongmei .
COMPUTERS IN BIOLOGY AND MEDICINE, 2017, 89 :18-23