Tumor Margin Classification of Head and Neck Cancer Using Hyperspectral Imaging and Convolutional Neural Networks

被引:15
|
作者
Halicek, Martin [1 ,2 ,3 ]
Little, James V. [4 ]
Wang, Xu [5 ]
Patel, Mihir [6 ,7 ]
Griffith, Christopher C. [4 ]
Chen, Amy Y. [6 ,7 ]
Fei, Baowei [1 ,2 ,7 ,8 ,9 ]
机构
[1] Georgia Inst Technol, Atlanta, GA 30332 USA
[2] Emory Univ, Wallace H Coulter Dept Biomed Engn, Atlanta, GA 30322 USA
[3] Augusta Univ, Med Coll Georgia, Augusta, GA USA
[4] Emory Univ, Sch Med, Dept Pathol & Lab Med, Atlanta, GA 30322 USA
[5] Emory Univ, Sch Med, Dept Hematol & Med Oncol, Atlanta, GA USA
[6] Emory Univ, Sch Med, Dept Otolaryngol, Atlanta, GA 30322 USA
[7] Emory Univ, Winship Canc Inst, Atlanta, GA 30322 USA
[8] Emory Univ, Dept Math & Comp Sci, Atlanta, GA 30322 USA
[9] Emory Univ, Dept Radiol & Imaging Sci, Atlanta, GA 30322 USA
来源
MEDICAL IMAGING 2018: IMAGE-GUIDED PROCEDURES, ROBOTIC INTERVENTIONS, AND MODELING | 2018年 / 10576卷
关键词
Hyperspectral imaging; convolutional neural network; deep learning; cancer margin detection; intraoperative imaging; head and neck surgery; head and neck cancer; SQUAMOUS-CELL CARCINOMA;
D O I
10.1117/12.2293167
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
One of the largest factors affecting disease recurrence after surgical cancer resection is negative surgical margins. Hyperspectral imaging (HSI) is an optical imaging technique with potential to serve as a computer aided diagnostic tool for identifying cancer in gross ex-vivo specimens. We developed a tissue classifier using three distinct convolutional neural network (CNN) architectures on HSI data to investigate the ability to classify the cancer margins from ex-vivo human surgical specimens, collected from 20 patients undergoing surgical cancer resection as a preliminary validation group. A new approach for generating the HSI ground truth using a registered histological cancer margin is applied in order to create a validation dataset. The CNN-based method classifies the tumor-normal margin of squamous cell carcinoma (SCCa) versus normal oral tissue with an area under the curve (AUC) of 0.86 for inter-patient validation, performing with 81% accuracy, 84% sensitivity, and 77% specificity. Thyroid carcinoma cancer-normal margins are classified with an AUC of 0.94 for inter-patient validation, performing with 90% accuracy, 91% sensitivity, and 88% specificity. Our preliminary results on a limited patient dataset demonstrate the predictive ability of HSI-based cancer margin detection, which warrants further investigation with more patient data and additional processing techniques to optimize the proposed deep learning method.
引用
收藏
页数:11
相关论文
共 50 条
  • [1] Optical Biopsy of Head and Neck Cancer Using Hyperspectral Imaging and Convolutional Neural Networks
    Halicek, Martin
    Little, James V.
    Wang, Xu
    Patel, Mihir
    Griffith, Christopher C.
    El-Deiry, Mark W.
    Chen, Amy Y.
    Fei, Baowei
    OPTICAL IMAGING, THERAPEUTICS, AND ADVANCED TECHNOLOGY IN HEAD AND NECK SURGERY AND OTOLARYNGOLOGY 2018, 2018, 10469
  • [2] Optical biopsy of head and neck cancer using hyperspectral imaging and convolutional neural networks
    Hahoek, Martin
    Little, James, V
    Wang, Xu
    Chen, Amy Y.
    Fei, Baowei
    JOURNAL OF BIOMEDICAL OPTICS, 2019, 24 (03)
  • [3] Deep convolutional neural networks for classifying head and neck cancer using hyperspectral imaging
    Halicek, Martin
    Lu, Guolan
    Little, James V.
    Wang, Xu
    Patel, Mihir
    Griffith, Christopher C.
    El-Deiry, Mark W.
    Chen, Amy Y.
    Fei, Baowei
    JOURNAL OF BIOMEDICAL OPTICS, 2017, 22 (06)
  • [4] Cancer Detection Using Hyperspectral Imaging and Evaluation of the Superficial Tumor Margin Variance with Depth
    Halicek, Martin
    Fabelo, Himar
    Ortega, Samuel
    Little, James V.
    Wang, Xu
    Chen, Amy Y.
    Callico, Gustavo Marrero
    Myers, Larry L.
    Sumer, Baran D.
    Fei, Baowei
    MEDICAL IMAGING 2019: IMAGE-GUIDED PROCEDURES, ROBOTIC INTERVENTIONS, AND MODELING, 2019, 10951
  • [5] Robust Tissue Differentiation in Head and Neck Cancer: Ex-vivo Study with Hyperspectral Imaging and Convolutional Neural Networks
    Lotfy, Mayar
    Zhang, Xiaohan
    Hauger, Christoph
    Giannantonio, Tommaso
    Alperovich, Anna
    Holm, Felix
    Navab, Nassir
    Boehm, Felix
    Schwamborn, Carolin
    Hoffmann, Thomas K.
    Schuler, Patrick J.
    OPTICS IN HEALTH CARE AND BIOMEDICAL OPTICS XIII, 2023, 12770
  • [6] Mineral Classification using Convolutional Neural Networks and SWIR Hyperspectral Imaging
    Cifuentes, Jose I.
    Arias, Luis E.
    Pirard, Eric
    Castillo, Fernando
    AI AND OPTICAL DATA SCIENCES V, 2024, 12903
  • [7] Hyperspectral imaging for head and neck cancer detection: specular glare and variance of the tumor margin in surgical specimens
    Halicek, Martin
    Fabelo, Himar
    Ortega, Samuel
    Little, James, V
    Wang, Xu
    Chen, Amy Y.
    Callico, Gustavo Marrero
    Myers, Larry
    Sumer, Baran D.
    Fei, Baowei
    JOURNAL OF MEDICAL IMAGING, 2019, 6 (03)
  • [8] Hyperspectral Imaging of Head and Neck Squamous Cell Carcinoma for Cancer Margin Detection in Surgical Specimens from 102 Patients Using Deep Learning
    Halicek, Martin
    Dormer, James D.
    Little, James, V
    Chen, Amy Y.
    Myers, Larry
    Sumer, Baran D.
    Fe, Baowei
    CANCERS, 2019, 11 (09)
  • [9] CLASSIFICATION OF HYPERSPECTRAL COLON CANCER IMAGES USING CONVOLUTIONAL NEURAL NETWORKS
    Mobilia, Sean
    Sirkeci-Mergen, Birsen
    Deal, Joshua
    Rich, Thomas C.
    Leavesley, Silas J.
    2019 IEEE DATA SCIENCE WORKSHOP (DSW), 2019, : 232 - 236
  • [10] Hyperspectral Image Classification with Convolutional Neural Networks
    Slavkovikj, Viktor
    Verstockt, Steven
    De Neve, Wesley
    Van Hoecke, Sofie
    Van de Walle, Rik
    MM'15: PROCEEDINGS OF THE 2015 ACM MULTIMEDIA CONFERENCE, 2015, : 1159 - 1162