Improved Diagnostic Imaging of Brain Tumors by Multimodal Microscopy and Deep Learning

被引:15
|
作者
Gesperger, Johanna [1 ,2 ]
Lichtenegger, Antonia [1 ]
Roetzer, Thomas [2 ]
Salas, Matthias [1 ]
Eugui, Pablo [1 ]
Harper, Danielle J. [1 ]
Merkle, Conrad W. [1 ]
Augustin, Marco [1 ]
Kiesel, Barbara [3 ]
Mercea, Petra A. [3 ]
Widhalm, Georg [3 ]
Baumann, Bernhard [1 ]
Woehrer, Adelheid [2 ]
机构
[1] Med Univ Vienna, Ctr Med Phys & Biomed Engn, A-1090 Vienna, Austria
[2] Med Univ Vienna, Dept Neurol, Div Neuropathol & Neurochem, A-1090 Vienna, Austria
[3] Med Univ Vienna, Dept Neurosurg, A-1090 Vienna, Austria
基金
欧盟地平线“2020”; 奥地利科学基金会; 欧洲研究理事会;
关键词
optical coherence tomography; glioma; metastasis; attenuation; FLUORESCENCE-GUIDED RESECTION; OPTICAL COHERENCE TOMOGRAPHY; 5-AMINOLEVULINIC ACID; INTRATUMOR HETEROGENEITY; GLIOBLASTOMA-MULTIFORME; EXTENT; GLIOMAS; SURVIVAL; SURGERY; DOMAIN;
D O I
10.3390/cancers12071806
中图分类号
R73 [肿瘤学];
学科分类号
100214 ;
摘要
Fluorescence-guided surgery is a state-of-the-art approach for intraoperative imaging during neurosurgical removal of tumor tissue. While the visualization of high-grade gliomas is reliable, lower grade glioma often lack visible fluorescence signals. Here, we present a hybrid prototype combining visible light optical coherence microscopy (OCM) and high-resolution fluorescence imaging for assessment of brain tumor samples acquired by 5-aminolevulinic acid (5-ALA) fluorescence-guided surgery. OCM provides high-resolution information of the inherent tissue scattering and absorption properties of tissue. We here explore quantitative attenuation coefficients derived from volumetric OCM intensity data and quantitative high-resolution 5-ALA fluorescence as potential biomarkers for tissue malignancy including otherwise difficult-to-assess low-grade glioma. We validate our findings against the gold standard histology and use attenuation and fluorescence intensity measures to differentiate between tumor core, infiltrative zone and adjacent brain tissue. Using large field-of-view scans acquired by a near-infrared swept-source optical coherence tomography setup, we provide initial assessments of tumor heterogeneity. Finally, we use cross-sectional OCM images to train a convolutional neural network that discriminates tumor from non-tumor tissue with an accuracy of 97%. Collectively, the present hybrid approach offers potential to translate into an in vivo imaging setup for substantially improved intraoperative guidance of brain tumor surgeries.
引用
收藏
页码:1 / 16
页数:16
相关论文
共 50 条
  • [1] Multimodal deep learning to predict prognosis in adult and pediatric brain tumors
    Steyaert, Sandra
    Qiu, Yeping Lina
    Zheng, Yuanning
    Mukherjee, Pritam
    Vogel, Hannes
    Gevaert, Olivier
    COMMUNICATIONS MEDICINE, 2023, 3 (01):
  • [2] Multimodal deep learning to predict prognosis in adult and pediatric brain tumors
    Sandra Steyaert
    Yeping Lina Qiu
    Yuanning Zheng
    Pritam Mukherjee
    Hannes Vogel
    Olivier Gevaert
    Communications Medicine, 3
  • [3] Deep learning protocol for improved photoacoustic brain imaging
    Manwar, Rayyan
    Li, Xin
    Mahmoodkalayeh, Sadreddin
    Asano, Eishi
    Zhu, Dongxiao
    Avanaki, Kamran
    JOURNAL OF BIOPHOTONICS, 2020, 13 (10)
  • [4] Multimodal magnetic resonance imaging of brain tumors
    Guillevin, R.
    Menuel, C.
    Vallee, J. N.
    REVUE NEUROLOGIQUE, 2011, 167 (10) : 704 - 714
  • [5] A Context-Supported Deep Learning Framework for Multimodal Brain Imaging Classification
    Jiang, Jianmin
    Fares, Ahmed
    Zhong, Sheng-Hua
    IEEE TRANSACTIONS ON HUMAN-MACHINE SYSTEMS, 2019, 49 (06) : 611 - 622
  • [6] Improved Multimodal Deep Learning with Variation of Information
    Sohn, Kihyuk
    Shang, Wenling
    Lee, Honglak
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 27 (NIPS 2014), 2014, 27
  • [7] Deep Learning and Improved Particle Swarm Optimization Based Multimodal Brain Tumor Classification
    Tahir, Ayesha Bin T.
    Khan, Muhamamd Attique
    Alhaisoni, Majed
    Khan, Junaid Ali
    Nam, Yunyoung
    Wang, Shui-Hua
    Javed, Kashif
    CMC-COMPUTERS MATERIALS & CONTINUA, 2021, 68 (01): : 1099 - 1116
  • [8] Clinical Manifestations and Diagnostic Imaging of Brain Tumors
    Keogh, Bart P.
    Henson, John W.
    HEMATOLOGY-ONCOLOGY CLINICS OF NORTH AMERICA, 2012, 26 (04) : 733 - +
  • [9] Diagnostic imaging of primary pediatric brain tumors
    Poussaint, Tina Young
    DISEASES OF THE BRAIN, HEAD & NECK, SPINE: DIAGNOSTIC IMAGING AND INTERVENTIONAL TECHNIQUES, 2008, : 277 - 287
  • [10] Multimodal brain tumor detection using multimodal deep transfer learning
    Razzaghi, Parvin
    Abbasi, Karim
    Shirazi, Mahmoud
    Rashidi, Shima
    APPLIED SOFT COMPUTING, 2022, 129