CoLM: Contrastive learning and multiple instance learning network for lung cancer classification of surgical options based on frozen pathological images

被引:0
作者
Zhao, Lu [1 ]
Zhao, Wangyuan [1 ]
Qiu, Lu [1 ]
Jiang, Mengqi [2 ]
Qian, Liqiang [3 ]
Ting, Hua-Nong [4 ]
Fu, Xiaolong [2 ]
Zhang, Puming [1 ]
Han, Yuchen [5 ]
Zhao, Jun [1 ]
机构
[1] Shanghai Jiao Tong Univ, Sch Biomed Engn, Shanghai, Peoples R China
[2] Shanghai Chest Hosp, Dept Radiat Oncol, Shanghai, Peoples R China
[3] Shanghai Chest Hosp, Dept Thorac Surg, Shanghai, Peoples R China
[4] Univ Malaya, Dept Biomed Engn, Kuala Lumpur, Malaysia
[5] Shanghai Chest Hosp, Dept Pathol, Shanghai, Peoples R China
基金
中国国家自然科学基金; 国家重点研发计划;
关键词
Lung cancer; Whole slide image; Contrastive learning; Image translation; Multiple instance learning; ARTIFICIAL-INTELLIGENCE; DIAGNOSIS;
D O I
10.1016/j.bspc.2024.107097
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Histopathological images are regarded as the gold standard in cancer diagnosis. Formalin-fixed paraffin- embedded (FFPE) tissues are routinely collected and archived for pathological examination. However, the time-consuming procedures of tissue fixation and embedding render FFPE tissues unsuitable for intraoperative diagnosis, where immediate results are crucial during surgical procedures. In contrast, obtaining afresh frozen section (FS) takes a very short time. FS samples are widely utilized for intraoperative diagnosis, whereas the diagnostic accuracy of FS is currently limited by the presence of potential histological artifacts. In this paper, we propose a contrastive learning image translation and multiple instance learning network (CoLM) for lung cancer classification. CoLM efficiently translates FS images into FFPE-style images and facilitates whole slide image classification. The entire framework encompasses two crucial stages. In the first stage, we employ a contrastive learning translation network with a dual-attention module (CL-DAM) for image translation. In the second stage, we utilize a hybrid transformer multi-instance learning-based network (HTM) to address the challenge posed by weak labels. We conduct experiments on lung cancer datasets to validate the performance of our proposed approach. The results demonstrate that our method achieve superior classification performance over other state-of-the-art methods, effectively mitigating the impact of blurred FS images. The proposed framework not only elevates the precision of intraoperative diagnosis when employing FS but also provides valuable reference for pathologists through the application of synthetic images.
引用
收藏
页数:10
相关论文
共 52 条
[21]   Patch-based Convolutional Neural Network for Whole Slide Tissue Image Classification [J].
Hou, Le ;
Samaras, Dimitris ;
Kurc, Tahsin M. ;
Gao, Yi ;
Davis, James E. ;
Saltz, Joel H. .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :2424-2433
[22]  
Ilse M, 2018, PR MACH LEARN RES, V80
[23]   Image-to-Image Translation with Conditional Adversarial Networks [J].
Isola, Phillip ;
Zhu, Jun-Yan ;
Zhou, Tinghui ;
Efros, Alexei A. .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :5967-5976
[24]   A Style-Based Generator Architecture for Generative Adversarial Networks [J].
Karras, Tero ;
Laine, Samuli ;
Aila, Timo .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :4396-4405
[25]   FFPE plus plus : Improving the quality of formalin-fixed paraffin-embedded tissue imaging via contrastive unpaired image-to-image translation [J].
Kassab, Mohamad ;
Jehanzaib, Muhammad ;
Basak, Kayhan ;
Demir, Derya ;
Keles, G. Evren ;
Turan, Mehmet .
MEDICAL IMAGE ANALYSIS, 2024, 91
[26]   Dual-stream Multiple Instance Learning Network for Whole Slide Image Classification with Self-supervised Contrastive Learning [J].
Li, Bin ;
Li, Yin ;
Eliceiri, Kevin W. .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :14313-14323
[27]   Intraoperative frozen section for identifying the invasion status of lung adenocarcinoma: A systematic review and meta-analysis [J].
Li, Feng ;
Yang, Lin ;
Zhao, Yue ;
Yuan, Ligong ;
Wang, Shuaibo ;
Mao, Yousheng .
INTERNATIONAL JOURNAL OF SURGERY, 2019, 72 :175-184
[28]   Data-efficient and weakly supervised computational pathology on whole-slide images [J].
Lu, Ming Y. ;
Williamson, Drew F. K. ;
Chen, Tiffany Y. ;
Chen, Richard J. ;
Barbieri, Matteo ;
Mahmood, Faisal .
NATURE BIOMEDICAL ENGINEERING, 2021, 5 (06) :555-+
[29]   Digital pathology and artificial intelligence [J].
Niazi, Muhammad Khalid Khan ;
Parwani, Anil V. ;
Gurcan, Metin N. .
LANCET ONCOLOGY, 2019, 20 (05) :E253-E261
[30]   The 2021 WHO Classification of Lung Tumors: Impact of Advances Since 2015 [J].
Nicholson, Andrew G. ;
Tsao, Ming S. ;
Beasley, Mary Beth ;
Borczuk, Alain C. ;
Brambilla, Elisabeth ;
Cooper, Wendy A. ;
Dacic, Sanja ;
Jain, Deepali ;
Kerr, Keith M. ;
Lantuejoul, Sylvie ;
Noguchi, Masayuki ;
Papotti, Mauro ;
Rekhtman, Natasha ;
Scagliotti, Giorgio ;
van Schil, Paul ;
Sholl, Lynette ;
Yatabe, Yasushi ;
Yoshida, Akihiko ;
Travis, William D. .
JOURNAL OF THORACIC ONCOLOGY, 2022, 17 (03) :362-387