Multi-scale feature fusion for prediction of IDH1 mutations in glioma histopathological images

被引:6
作者
Liu, Xiang [1 ,2 ]
Hu, Wanming [3 ]
Diao, Songhui [1 ,2 ]
Abera, Deboch Eyob [1 ,2 ]
Racoceanu, Daniel [4 ]
Qin, Wenjian [1 ]
机构
[1] Chinese Acad Sci, Shenzhen Inst Adv Technol, Shenzhen 518055, Peoples R China
[2] Univ Chinese Acad Sci, Shenzhen Coll Adv Technol, Shenzhen 518055, Peoples R China
[3] Sun Yat Sen Univ, Guangdong Prov Clin Res Ctr Canc, Dept Pathol,Canc Ctr, State Key Lab Oncol South China, Guangzhou 510060, Peoples R China
[4] Sorbonne Univ, INRIA, AP HP, Paris Brain Inst ICM,Inserm,CNRS, F-75013 Paris, France
基金
中国国家自然科学基金;
关键词
IDH1 mutation identification; Brain glioma; Pathological image; Deep neural networks; Multi-scale information fusion; CENTRAL-NERVOUS-SYSTEM; TUMORS; CLASSIFICATION; COLOR;
D O I
10.1016/j.cmpb.2024.108116
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Background and objective: Mutations in isocitrate dehydrogenase 1 (IDH1) play a crucial role in the prognosis, diagnosis, and treatment of gliomas. However, current methods for determining its mutation status, such as immunohistochemistry and gene sequencing, are difficult to implement widely in routine clinical diagnosis. Recent studies have shown that using deep learning methods based on pathological images of glioma can predict the mutation status of the IDH1 gene. However, our research focuses on utilizing multi-scale information in pathological images to improve the accuracy of predicting IDH1 gene mutations, thereby providing an accurate and cost-effective prediction method for routine clinical diagnosis. Methods: In this paper, we propose a multi-scale fusion gene identification network (MultiGeneNet). The network first uses two feature extractors to obtain feature maps at different scale images, and then by employing a bilinear pooling layer based on Hadamard product to realize the fusion of multi-scale features. Through fully exploiting the complementarity among features at different scales, we are able to obtain a more comprehensive and rich representation of multi-scale features. Results: Based on the Hematoxylin and Eosin stained pathological section dataset of 296 patients, our method achieved an accuracy of 83.575 % and an AUC of 0.886, thus significantly outperforming other single-scale methods. Conclusions: Our method can be deployed in medical aid systems at very low cost, serving as a diagnostic or prognostic tool for glioma patients in medically underserved areas.
引用
收藏
页数:10
相关论文
共 33 条
[1]   Classification and mutation prediction from non-small cell lung cancer histopathology images using deep learning [J].
Coudray, Nicolas ;
Ocampo, Paolo Santiago ;
Sakellaropoulos, Theodore ;
Narula, Navneet ;
Snuderl, Matija ;
Fenyo, David ;
Moreira, Andre L. ;
Razavian, Narges ;
Tsirigos, Aristotelis .
NATURE MEDICINE, 2018, 24 (10) :1559-+
[2]   A Multiple-Instance Learning-Based Convolutional Neural Network Model to Detect the IDH1 Mutation in the Histopathology Images of Glioma Tissues [J].
Cui, Danni ;
Liu, Yingying ;
Liu, Gang ;
Liu, Lei .
JOURNAL OF COMPUTATIONAL BIOLOGY, 2020, 27 (08) :1264-1272
[3]  
Densmore I., 2022, Assessing the impact of adjuvant temozolomide duration on survival in patients with IDH-mutant low-grade gliomas (P6-9.001)
[4]   Deep Multi-Magnification Similarity Learning for Histopathological Image Classification [J].
Diao, Songhui ;
Luo, Weiren ;
Hou, Jiaxin ;
Lambo, Ricardo ;
AL-kuhali, Hamas A. ;
Zhao, Hanqing ;
Tian, Yinli ;
Xie, Yaoqin ;
Zaki, Nazar ;
Qin, Wenjian .
IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2023, 27 (03) :1535-1545
[5]   Weakly Supervised Framework for Cancer Region Detection of Hepatocellular Carcinoma in Whole-Slide Pathologic Images Based on Multiscale Attention Convolutional Neural Network [J].
Diao, Songhui ;
Tian, Yinli ;
Hu, Wanming ;
Hou, Jiaxin ;
Lambo, Ricardo ;
Zhang, Zhicheng ;
Xie, Yaoqin ;
Nie, Xiu ;
Zhang, Fa ;
Racoceanu, Daniel ;
Qin, Wenjian .
AMERICAN JOURNAL OF PATHOLOGY, 2022, 192 (03) :553-563
[6]  
Dosovitskiy A, 2021, Arxiv, DOI arXiv:2010.11929
[7]   Color for object recognition: Hue and chroma sensitivity in the deep features of convolutional neural networks [J].
Flachot, Alban ;
Gegenfurtner, Karl R. .
VISION RESEARCH, 2021, 182 :89-100
[8]   Pan-cancer computational histopathology reveals mutations, tumor composition and prognosis [J].
Fu, Yu ;
Jung, Alexander W. ;
Torne, Ramon Vinas ;
Gonzalez, Santiago ;
Vohringer, Harald ;
Shmatko, Artem ;
Yates, Lucy R. ;
Jimenez-Linan, Mercedes ;
Moore, Luiza ;
Gerstung, Moritz .
NATURE CANCER, 2020, 1 (08) :800-+
[9]   3D AGSE-VNet: an automatic brain tumor MRI data segmentation framework [J].
Guan, Xi ;
Yang, Guang ;
Ye, Jianming ;
Yang, Weiji ;
Xu, Xiaomei ;
Jiang, Weiwei ;
Lai, Xiaobo .
BMC MEDICAL IMAGING, 2022, 22 (01)
[10]   Predicting tumour mutational burden from histopathological images using multiscale deep learning [J].
Jain, Mika S. ;
Massoud, Tarik F. .
NATURE MACHINE INTELLIGENCE, 2020, 2 (06) :356-362