CVMIL: Cluster Variance Multiple Instance Learning for Whole Slide Images Survival Prediction

被引:0
作者
Chen, Shiqi [1 ]
Cai, Du [2 ]
Li, Chenghang [3 ]
Wang, Ruixuan [1 ]
Gao, Feng [2 ]
机构
[1] Sun Yat Sen Univ, Guangzhou, Guangdong, Peoples R China
[2] Sun Yat Sen Univ, Affiliated Hosp 6, Guangzhou, Guangdong, Peoples R China
[3] Hong Kong Univ Sci & Technol, Guangzhou, Guangdong, Peoples R China
来源
2024 2ND ASIA CONFERENCE ON COMPUTER VISION, IMAGE PROCESSING AND PATTERN RECOGNITION, CVIPPR 2024 | 2024年
关键词
whole slide image; computational pathology; survival prediction;
D O I
10.1145/3663976.3663993
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Tumor survival prediction using whole slide images (WSIs) is a crucial application in pathology aimed at assisting doctors in better formulating post-surgical treatment plans. The key challenges in current WSIs survival prediction lie in the vast scale of WSIs and the scarcity of manual annotations, which hinders the extraction of effective information from WSIs. To address these issues, previous studies have mainly employed the multiple instance learning (MIL) approach. However, existing methods often fail to consider the complexity of tumors and integrate clinically relevant knowledge, leading to suboptimal outcomes in survival prediction. To capture the intricate characteristics of tumors, we propose Cluster Variance Multiple Instance Learning (CVMIL) framework capable of representing tumor heterogeneity. By leveraging the differences from cluster centers, CVMIL represents both intra-tumor and inter-tumor heterogeneity, thereby enhancing the performance of MIL methods in WSI survival prediction. Results from prognosis tasks conducted on three publicly available TCGA datasets and the in-house ARGO dataset demonstrate that our approach outperforms current state-of-the-art methods, enabling more effective prediction of patient prognosis.
引用
收藏
页数:7
相关论文
共 50 条
[21]   Prototypical multiple instance learning for predicting lymph node metastasis of breast cancer from whole-slide pathological images [J].
Yu, Jin-Gang ;
Wu, Zihao ;
Ming, Yu ;
Deng, Shule ;
Li, Yuanqing ;
Ou, Caifeng ;
He, Chunjiang ;
Wang, Baiye ;
Zhang, Pusheng ;
Wang, Yu .
MEDICAL IMAGE ANALYSIS, 2023, 85
[22]   Inter-Intra Hypergraph Computation for Survival Prediction on Whole Slide Images [J].
Han, Xiangmin ;
Zhou, Huijian ;
Tian, Zhiqiang ;
Du, Shaoyi ;
Gao, Yue .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2025, 47 (07) :6006-6021
[23]   Cellular Architecture on Whole Slide Images Allows the Prediction of Survival in Lung Adenocarcinoma [J].
Chen, Pingjun ;
Saad, Maliazurina B. ;
Rojas, Frank R. ;
Salehjahromi, Morteza ;
Aminu, Muhammad ;
Bandyopadhyay, Rukhmini ;
Hong, Lingzhi ;
Ebare, Kingsley ;
Behrens, Carmen ;
Gibbons, Don L. ;
Kalhor, Neda ;
Heymach, John, V ;
Wistuba, Ignacio I. ;
Soto, Luisa M. Solis ;
Zhang, Jianjun ;
Wu, Jia .
COMPUTATIONAL MATHEMATICS MODELING IN CANCER ANALYSIS, CMMCA 2022, 2022, 13574 :1-10
[24]   Deep Multi-Dictionary Learning for Survival Prediction With Multi-Zoom Histopathological Whole Slide Images [J].
Tu, Chao ;
Du, Denghui ;
Zeng, Tieyong ;
Zhang, Yu .
IEEE-ACM TRANSACTIONS ON COMPUTATIONAL BIOLOGY AND BIOINFORMATICS, 2024, 21 (01) :14-25
[25]   MSMMIL: Multi-scan Mamba-based Multiple Instance Learning for whole slide image classification [J].
Zhong, Haiqin ;
Ding, Meidan ;
Zhao, Cheng ;
Zhang, Yongtao ;
Wang, Tianfu ;
Lei, Baiying .
KNOWLEDGE-BASED SYSTEMS, 2025, 324
[26]   Multi-Scale Context-Aware Survival Prediction Network Based on Whole Slide Images [J].
Hao, Yatong ;
Wei, Mingjie ;
Zhao, Shuang ;
Duan, Xiaodong ;
Yao, Yiqun .
2024 IEEE 8TH INTERNATIONAL CONFERENCE ON VISION, IMAGE AND SIGNAL PROCESSING, ICVISP, 2024,
[27]   ReMix: A General and Efficient Framework for Multiple Instance Learning Based Whole Slide Image Classification [J].
Yang, Jiawei ;
Chen, Hanbo ;
Zhao, Yu ;
Yang, Fan ;
Zhang, Yao ;
He, Lei ;
Yao, Jianhua .
MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2022, PT II, 2022, 13432 :35-45
[28]   TRANSFORMER-BASED MULTIMODAL FUSION FOR SURVIVAL PREDICTION BY INTEGRATING WHOLE SLIDE IMAGES, CLINICAL, AND GENOMIC DATA [J].
Chen, Yihang ;
Zhao, Weiqin ;
Yu, Lequan .
2023 IEEE 20TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING, ISBI, 2023,
[29]   Multi-Scale Hierarchical Context-Aware Survival Prediction Network based on whole slide images [J].
Song, Jinmiao ;
Hao, Yatong ;
Zhai, Hui ;
Zhao, Shuang ;
Ning, Tao ;
Huang, Shan ;
Duan, Xiaodong .
BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2025, 110
[30]   Identification lymph node metastasis in esophageal squamous cell carcinoma using whole slide images and a hybrid network of multiple instance and transfer learning [J].
Kang, Huan ;
Yang, Meilin ;
Zhang, Fan ;
Xu, Huiya ;
Ren, Shenghan ;
Li, Jun ;
Chen, Duofang ;
Wang, Fen ;
Li, Dan ;
Chen, Xueli .
BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2023, 82