Hyperspectral Brain Tissue Classification using a Fast and Compact 3D CNN Approach

被引:1
作者
Ayaz, Hamail [1 ,2 ]
Tormey, David [1 ,3 ]
McLoughlin, Ian [4 ]
Ahmad, Muhammad [5 ]
Unnikrishnan, Saritha [1 ,2 ]
机构
[1] Atlantic Technol Univ, Fac Engn & Design, Sligo, Ireland
[2] Atlantic Technol Univ, Math Modelling & Intelligent Syst Hlth & Environm, Sligo, Ireland
[3] Atlantic Technol Univ, Ctr Precis Engn Mat & Mfg Res PEM, Sligo, Ireland
[4] Atlantic Technol Univ, Dept Comp Sci & Appl Phys, Galway, Ireland
[5] Natl Univ Comp & Emerging Sci, Dept Comp Sci, Chiniot 35400, Pakistan
来源
2022 IEEE 5TH INTERNATIONAL CONFERENCE ON IMAGE PROCESSING APPLICATIONS AND SYSTEMS, IPAS | 2022年
关键词
Medical Imaging; Vivo-HSI Data; Deep Learning; Classification;
D O I
10.1109/IPAS55744.2022.10053044
中图分类号
TP7 [遥感技术];
学科分类号
081102 ; 0816 ; 081602 ; 083002 ; 1404 ;
摘要
Glioblastoma (GB) is a malignant brain tumor and requires surgical resection. Although complete resection of GB improves prognosis, supratotal resection may cause neurological abnormalities. Therefore, intraoperative tissue classification techniques are needed to delineate infected tumor regions to remove reoccurrences. To delineate the affected regions, surgeons mostly rely on traditional magnetic resonance imaging (MRI) which often lacks accuracy and precision due to the brain-shift phenomenon. Hyperspectral Imaging (HSI) is a noninvasive advanced optical technique and has the potential to classify tissue cells accurately. However, HSI tumor classification is challenging due to overlapping regions, high interclass similarity, and homogeneous information. Additionally, HSI models using 2D Convolutional Neural Network (CNN) models works with spectral information eliminating spatial features and 3D followed by 2D hybrid model lacks abstract level spatial information. Therefore, in this study, we have used a minimal layer 3D CNN model to classify the GB tumor region from normal tissues using an intraoperative VivoHSI dataset. The HSI data have normal tissue (NT), tumor tissue (TT), hypervascularized tissue or blood vessels (BV), and background (BG) tissue cells. The proposed 3D CNN model consists of only two 3D layers using limited training samples (20%), which are further divided into 50% for training and 50% for validation and blind tested (80%) on the rest of the data. This study outperformed then state-of-the-art hybrid architecture by achieving an overall accuracy of 99.99%.
引用
收藏
页数:7
相关论文
共 50 条
[21]   A new self-augment CNN for 3D point cloud classification and segmentation [J].
Meng, Xinhong ;
Lu, Xinyu ;
Ye, Hailiang ;
Yang, Bing ;
Cao, Feilong .
INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2024, 15 (03) :807-818
[22]   Incremental Dilations Using CNN for Brain Tumor Classification [J].
Roy, Sanjiban Sekhar ;
Rodrigues, Nishant ;
Taguchi, Y-h. .
APPLIED SCIENCES-BASEL, 2020, 10 (14)
[23]   HybridSN: Exploring 3-D-2-D CNN Feature Hierarchy for Hyperspectral Image Classification [J].
Roy, Swalpa Kumar ;
Krishna, Gopal ;
Dubey, Shiv Ram ;
Chaudhuri, Bidyut B. .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2020, 17 (02) :277-281
[24]   Brain tissue classification in hyperspectral images using multistage diffusion features and transformer [J].
Sigger, Neetu ;
Nguyen, Tuan T. ;
Tozzi, Gianluca .
JOURNAL OF MICROSCOPY, 2024,
[25]   A Deep Learning approach to Hyperspectral Image Classification using an improved Hybrid 3D-2D Convolutional Neural Network [J].
Koumoutsou, Dimitra ;
Charou, Eleni .
PROCEEDINGS OF THE 11TH SETN CONFERENCE ON ARTIFICIAL INTELLIGENCE, SETN 2020, 2020, :85-92
[26]   3D Model Classification and Retrieval Based on CNN and Voting Scheme [J].
Bai J. ;
Si Q. ;
Qin F. .
Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics, 2019, 31 (02) :303-314
[27]   Analysis of the influence of 3D-CNN on spatial random information in hyperspectral image classification [J].
Kang, Byungjin ;
Kim, Sungho .
2021 21ST INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION AND SYSTEMS (ICCAS 2021), 2021, :1123-1126
[28]   Classification of Neurodevelopmental Age in Normal Infants Using 3D-CNN based on Brain MRI [J].
Shabanian, Mandieh ;
Eckstein, Eugene C. ;
Chen, Hao ;
DeVincenzo, John P. .
2019 IEEE INTERNATIONAL CONFERENCE ON BIOINFORMATICS AND BIOMEDICINE (BIBM), 2019, :2373-2378
[29]   Fast Evaluation of Unhealthy and Healthy Neonates Using Hyperspectral Features on 700-850 Nm Wavelengths, ROI Extraction, and 3D-CNN [J].
Cihan, M. ;
Ceylan, M. ;
Soylu, H. ;
Konak, M. .
IRBM, 2022, 43 (05) :362-371
[30]   3D SEGMENTATION OF MRI BRAIN USING LEVEL SET AND UNSUPERVISED CLASSIFICATION [J].
Bourouis, Sami ;
Hamrouni, Kamel .
INTERNATIONAL JOURNAL OF IMAGE AND GRAPHICS, 2010, 10 (01) :135-154