A SURVIVAL ANALYSIS AND GRADE PREDICTION MODEL FOR LUNG SQUAMOUS CELL CARCINOMA BASED ON MULTIPLE-INSTANCE LEARNING AND MULTI-SCALE TRANSFORMER

被引:0
作者
Li, Le [1 ]
Liang, Yong [2 ,3 ]
Guo, Yongqiang [4 ]
Shao, Mingwen [5 ]
Lu, Shanghui [6 ]
Liao, Shuilin [6 ]
机构
[1] Macau Univ Sci & Technol, Sch Fac Innovat Engn, Macau 999078, Peoples R China
[2] Guangdong Prov Lab Tradit, Hengqin Lab, Chinese Med, Hengqin 519031, Peoples R China
[3] Univ Chinese Med, Affliated Hosp Guangzhou 2, State Key Lab Dampness Syndrome Chinese Med, Guangzhou 510006, Peoples R China
[4] iFLYTEK Co, Qingdao 266555, Peoples R China
[5] China Univ Petr, Coll Comp Sci & Technol, Qingdao 266580, Peoples R China
[6] Macau Univ Sci & Technol, Sch Fac Innovat Engn, Macau 999078, Peoples R China
基金
美国国家科学基金会;
关键词
Grade prediction; lung squamous cell carcinoma; multiple-instance learning; multi-scale transformer; respiratory diseases; survival analysis;
D O I
10.1142/S0219519425400214
中图分类号
Q6 [生物物理学];
学科分类号
071011 ;
摘要
Respiratory diseases are now the third leading cause of death worldwide. Lung squamous cell carcinoma (LUSC) has one of the highest morbidity and mortality rates among respiratory diseases. Therefore, constructing a model based on the pathological images for survival analysis and grade prediction of LUSC is of great significance for designing personalized solutions for LUSC. The current LUSC survival analysis and grade prediction model mainly has two issues. First, it lacks high-performance multi-scale feature methods, limiting the model's ability to discriminate LUSC case images. Second, the feature extractor has a high degree of redundancy, resulting in many repeated calculations. Excessive feature extraction can be regarded as noise, which not only increases the training cost of the model but also reduces the model performance. This study aimed to address these limitations by proposing a multiple-instance learning-based multi-scale transformer (MSTrans-MIL) for LUSC survival analysis and grade prediction. The contributions of this study were as follows. First, we proposed a feature sampling module (FSM) based on a self-attention mechanism, which was conducive to reducing information redundancy in the input space and improving the model's applicability. Second, we constructed a multi-scale pathology feature extraction module based on self-supervised learning and introduced a convolution-transformer to adequately extract the local and global features of images on different scales. The multi-scale chains are also beneficial to understanding the interaction between the tissue microenvironment and tumor cells. In addition, a multi-scale feature encoder with sparse Transformer was proposed to further reduce the feature redundancy, and a multi-scale feature aggregation module using the gating unit was constructed to enhance the hierarchy of the feature representations and improve the robustness and accuracy of the model. Abundant ablation and comparison experiments demonstrated that the proposed MSTrans-MIL could reduce feature redundancy and improve the prediction of LUSC grading and prognosis.
引用
收藏
页数:17
相关论文
共 37 条
[1]  
Afonso Martim, 2024, J Pathol Inform, V15, P100403, DOI 10.1016/j.jpi.2024.100403
[2]   Deep ROC Analysis and AUC as Balanced Average Accuracy, for Improved Classifier Selection, Audit and Explanation [J].
Carrington, Andre M. ;
Manuel, Douglas G. ;
Fieguth, Paul W. ;
Ramsay, Tim ;
Osmani, Venet ;
Wernly, Bernhard ;
Bennett, Carol ;
Hawken, Steven ;
Magwood, Olivia ;
Sheikh, Yusuf ;
McInnes, Matthew ;
Holzinger, Andreas .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (01) :329-341
[3]   Automated invasive ductal carcinoma detection based using deep transfer learning with whole-slide images [J].
Celik, Yusuf ;
Talo, Muhammed ;
Yildirim, Ozal ;
Karabatak, Murat ;
Acharya, U. Rajendra .
PATTERN RECOGNITION LETTERS, 2020, 133 :232-239
[4]   Lung adenocarcinoma and lung squamous cell carcinoma cancer classification, biomarker identification, and gene expression analysis using overlapping feature selection methods [J].
Chen, Joe W. ;
Dhahbi, Joseph .
SCIENTIFIC REPORTS, 2021, 11 (01) :13323
[5]   Scaling Vision Transformers to Gigapixel Images via Hierarchical Self-Supervised Learning [J].
Chen, Richard J. ;
Chen, Chengkuan ;
Li, Yicong ;
Chen, Tiffany Y. ;
Trister, Andrew D. ;
Krishnan, Rahul G. ;
Mahmood, Faisal .
2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, :16123-16134
[6]   A whole-slide image (WSI)-based immunohistochemical feature prediction system improves the subtyping of lung cancer [J].
Chen, Yanyang ;
Yang, Huan ;
Cheng, Zhiqiang ;
Chen, Lili ;
Peng, Sui ;
Wang, Jianbo ;
Yang, Minglei ;
Lin, Chenghao ;
Chen, Yu ;
Wang, Yuefeng ;
Huang, Leilei ;
Chen, Yangshan ;
Li, Weizhong ;
Ke, Zunfu .
LUNG CANCER, 2022, 165 :18-27
[7]  
Chung J, 2014, ARXIV
[8]   Selection, Visualization, and Interpretation of Deep Features in Lung Adenocarcinoma and Squamous Cell Carcinoma [J].
Dehkharghanian, Taher ;
Rahnamayan, Shahryar ;
Riasatian, Abtin ;
Bidgoli, Azam A. ;
Kalra, Shivam ;
Zaveri, Manit ;
Babaie, Morteza ;
Sajadi, Mahjabin S. Seyed ;
Gonzalelz, Ricardo ;
Diamandis, Phedias ;
Pantanowitz, Liron ;
Huang, Tao ;
Tizhoosh, Hamid R. .
AMERICAN JOURNAL OF PATHOLOGY, 2021, 191 (12) :2172-2183
[9]   Circulating tumor cell isolation for cancer diagnosis and prognosis [J].
Deng, Zicheng ;
Wu, Shengming ;
Wang, Yilong ;
Shi, Donglu .
EBIOMEDICINE, 2022, 83
[10]  
Dou Q., 2018, ARXIV