Deep-learning-assisted microscopy with ultraviolet surface excitation for rapid slide-free histological imaging

被引:25
作者
Chen, Zhenghui [1 ]
Yu, Wentao [1 ]
Wong, Ivy H. M. [1 ]
Wong, Terence T. W. [1 ]
机构
[1] Hong Kong Univ Sci & Technol, Dept Chem & Biol Engn, Kowloon, Clear Water Bay, Hong Kong, Peoples R China
关键词
44;
D O I
10.1364/BOE.433597
中图分类号
Q5 [生物化学];
学科分类号
071010 ; 081704 ;
摘要
Histopathological examination of tissue sections is the gold standard for disease diagnosis. However, the conventional histopathology workflow requires lengthy and laborious sample preparation to obtain thin tissue slices, causing about a one-week delay to generate an accurate diagnostic report. Recently, microscopy with ultraviolet surface excitation (MUSE), a rapid and slide-free imaging technique, has been developed to image fresh and thick tissues with specific molecular contrast. Here, we propose to apply an unsupervised generative adversarial network framework to translate colorful MUSE images into Deep-MUSE images that highly resemble hematoxylin and eosin staining, allowing easy adaptation by pathologists. By eliminating the needs of all sample processing steps (except staining), a MUSE image with subcellular resolution for a typical brain biopsy (5 mm x 5 mm) can be acquired in 5 minutes, which is further translated into a Deep-MUSE image in 40 seconds, simplifying the standard histopathology workflow dramatically and providing histological images intraoperatively.
引用
收藏
页码:5920 / 5938
页数:19
相关论文
共 43 条
[1]  
Abraham T., 2020, PRESENTED ICML COMPU
[2]  
[Anonymous], 2016, INT C LEARN REPR ICL
[3]   The 2018 PIRM Challenge on Perceptual Image Super-Resolution [J].
Blau, Yochai ;
Mechrez, Roey ;
Timofte, Radu ;
Michaeli, Tomer ;
Zelnik-Manor, Lihi .
COMPUTER VISION - ECCV 2018 WORKSHOPS, PT V, 2019, 11133 :334-355
[4]   Clinical-grade computational pathology using weakly supervised deep learning on whole slide images [J].
Campanella, Gabriele ;
Hanna, Matthew G. ;
Geneslaw, Luke ;
Miraflor, Allen ;
Silva, Vitor Werneck Krauss ;
Busam, Klaus J. ;
Brogi, Edi ;
Reuter, Victor E. ;
Klimstra, David S. ;
Fuchs, Thomas J. .
NATURE MEDICINE, 2019, 25 (08) :1301-+
[5]   StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translation [J].
Choi, Yunjey ;
Choi, Minje ;
Kim, Munyoung ;
Ha, Jung-Woo ;
Kim, Sunghun ;
Choo, Jaegul .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :8789-8797
[6]   Classification and mutation prediction from non-small cell lung cancer histopathology images using deep learning [J].
Coudray, Nicolas ;
Ocampo, Paolo Santiago ;
Sakellaropoulos, Theodore ;
Narula, Navneet ;
Snuderl, Matija ;
Fenyo, David ;
Moreira, Andre L. ;
Razavian, Narges ;
Tsirigos, Aristotelis .
NATURE MEDICINE, 2018, 24 (10) :1559-+
[7]   Microscopy with ultraviolet surface excitation for rapid slide-free histology [J].
Fereidouni, Farzad ;
Harmany, Zachary T. ;
Tian, Miao ;
Todd, Austin ;
Kintner, John A. ;
McPherson, John D. ;
Borowsky, Alexander D. ;
Bishop, John ;
Lechpammer, Mirna ;
Demos, Stavros G. ;
Levenson, Richard .
NATURE BIOMEDICAL ENGINEERING, 2017, 1 (12) :957-+
[8]   Comparison of Fresh Frozen Tissue With Formalin-Fixed Paraffin-Embedded Tissue for Mutation Analysis Using a Multi-Gene Panel in Patients With Colorectal Cancer [J].
Gao, Xian Hua ;
Li, Juan ;
Gong, Hai Feng ;
Yu, Guan Yu ;
Liu, Peng ;
Hao, Li Qiang ;
Liu, Lian Jie ;
Bai, Chen Guang ;
Zhang, Wei .
FRONTIERS IN ONCOLOGY, 2020, 10
[9]   Feasibility of digitally stained multimodal confocal mosaics to simulate histopathology [J].
Gareau, Daniel S. .
JOURNAL OF BIOMEDICAL OPTICS, 2009, 14 (03)
[10]   Confocal mosaicing microscopy in Mohs skin excisions: feasibility of rapid surgical pathology [J].
Gareau, Daniel S. ;
Li, Yongbiao ;
Huang, Billy ;
Eastman, Zach ;
Nehal, Kishwer S. ;
Rajadhyaksha, Milind .
JOURNAL OF BIOMEDICAL OPTICS, 2008, 13 (05)