CoLM: Contrastive learning and multiple instance learning network for lung cancer classification of surgical options based on frozen pathological images

被引:0
作者
Zhao, Lu [1 ]
Zhao, Wangyuan [1 ]
Qiu, Lu [1 ]
Jiang, Mengqi [2 ]
Qian, Liqiang [3 ]
Ting, Hua-Nong [4 ]
Fu, Xiaolong [2 ]
Zhang, Puming [1 ]
Han, Yuchen [5 ]
Zhao, Jun [1 ]
机构
[1] Shanghai Jiao Tong Univ, Sch Biomed Engn, Shanghai, Peoples R China
[2] Shanghai Chest Hosp, Dept Radiat Oncol, Shanghai, Peoples R China
[3] Shanghai Chest Hosp, Dept Thorac Surg, Shanghai, Peoples R China
[4] Univ Malaya, Dept Biomed Engn, Kuala Lumpur, Malaysia
[5] Shanghai Chest Hosp, Dept Pathol, Shanghai, Peoples R China
基金
中国国家自然科学基金; 国家重点研发计划;
关键词
Lung cancer; Whole slide image; Contrastive learning; Image translation; Multiple instance learning; ARTIFICIAL-INTELLIGENCE; DIAGNOSIS;
D O I
10.1016/j.bspc.2024.107097
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Histopathological images are regarded as the gold standard in cancer diagnosis. Formalin-fixed paraffin- embedded (FFPE) tissues are routinely collected and archived for pathological examination. However, the time-consuming procedures of tissue fixation and embedding render FFPE tissues unsuitable for intraoperative diagnosis, where immediate results are crucial during surgical procedures. In contrast, obtaining afresh frozen section (FS) takes a very short time. FS samples are widely utilized for intraoperative diagnosis, whereas the diagnostic accuracy of FS is currently limited by the presence of potential histological artifacts. In this paper, we propose a contrastive learning image translation and multiple instance learning network (CoLM) for lung cancer classification. CoLM efficiently translates FS images into FFPE-style images and facilitates whole slide image classification. The entire framework encompasses two crucial stages. In the first stage, we employ a contrastive learning translation network with a dual-attention module (CL-DAM) for image translation. In the second stage, we utilize a hybrid transformer multi-instance learning-based network (HTM) to address the challenge posed by weak labels. We conduct experiments on lung cancer datasets to validate the performance of our proposed approach. The results demonstrate that our method achieve superior classification performance over other state-of-the-art methods, effectively mitigating the impact of blurred FS images. The proposed framework not only elevates the precision of intraoperative diagnosis when employing FS but also provides valuable reference for pathologists through the application of synthetic images.
引用
收藏
页数:10
相关论文
共 52 条
[1]   Weakly-supervised deep learning model for prostate cancer diagnosis and Gleason grading of histopathology images [J].
Behzadi, Mohammad Mahdi ;
Madani, Mohammad ;
Wang, Hanzhang ;
Bai, Jun ;
Bhardwaj, Ankit ;
Tarakanova, Anna ;
Yamase, Harold ;
Nam, Ga Hie ;
Nabavi, Sheida .
BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2024, 95
[2]   Accuracy of the IASLC/ATS/ERS histological subtyping of stage I lung adenocarcinoma on intraoperative frozen sections [J].
Bittar, Humberto E. Trejo ;
Incharoen, Pimpin ;
Althouse, Andrew D. ;
Dacic, Sanja .
MODERN PATHOLOGY, 2015, 28 (08) :1058-1063
[3]   Pyramidal position attention model for histopathological image segmentation [J].
Bozdag, Zehra ;
Talu, Muhammed Fatih .
BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2023, 80
[4]   Clinical-grade computational pathology using weakly supervised deep learning on whole slide images [J].
Campanella, Gabriele ;
Hanna, Matthew G. ;
Geneslaw, Luke ;
Miraflor, Allen ;
Silva, Vitor Werneck Krauss ;
Busam, Klaus J. ;
Brogi, Edi ;
Reuter, Victor E. ;
Klimstra, David S. ;
Fuchs, Thomas J. .
NATURE MEDICINE, 2019, 25 (08) :1301-+
[5]   Multiple instance learning: A survey of problem characteristics and applications [J].
Carbonneau, Marc-Andre ;
Cheplygina, Veronika ;
Granger, Eric ;
Gagnon, Ghyslain .
PATTERN RECOGNITION, 2018, 77 :329-353
[6]   Scaling Vision Transformers to Gigapixel Images via Hierarchical Self-Supervised Learning [J].
Chen, Richard J. ;
Chen, Chengkuan ;
Li, Yicong ;
Chen, Tiffany Y. ;
Trister, Andrew D. ;
Krishnan, Rahul G. ;
Mahmood, Faisal .
2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, :16123-16134
[7]   Tumor histology predicts mediastinal nodal status and may be used to guide limited lymphadenectomy in patients with clinical stage I non-small cell lung cancer [J].
Cheng, Xinghua ;
Zheng, Difan ;
Li, Yuan ;
Li, Hang ;
Sun, Yihua ;
Xiang, Jiaqing ;
Chen, Haiquan .
JOURNAL OF THORACIC AND CARDIOVASCULAR SURGERY, 2018, 155 (06) :2648-+
[8]   AI in Computational Pathology of Cancer: Improving DiagnosticWorkflows and Clinical Outcomes? [J].
Cifci, Didem ;
Veldhuizen, Gregory P. ;
Foersch, Sebastian ;
Kather, Jakob Nikolas .
ANNUAL REVIEW OF CANCER BIOLOGY, 2023, 7 :57-71
[9]   Generative Adversarial Networks An overview [J].
Creswell, Antonia ;
White, Tom ;
Dumoulin, Vincent ;
Arulkumaran, Kai ;
Sengupta, Biswa ;
Bharath, Anil A. .
IEEE SIGNAL PROCESSING MAGAZINE, 2018, 35 (01) :53-65
[10]   Evaluation of the solitary pulmonary nodule [J].
Cruickshank, Ashleigh ;
Stieler, Geoff ;
Ameer, Faisal .
INTERNAL MEDICINE JOURNAL, 2019, 49 (03) :306-315