Advancing laser ablation assessment in hyperspectral imaging through machine learning

Hyperspectral imaging (HSI) is gaining increasing relevance in medicine, with an innovative application being the intraoperative assessment of the outcome of laser ablation treatment used for minimally invasive tumor removal. However, the high dimensionality and complexity of HSI data create a need for end-to-end image processing workflows specifically tailored to handle these data. This study addresses this challenge by proposing a multi-stage workflow for the analysis of hyperspectral data and allows investigating the performance of different components and modalities for ablation detection and segmentation. To address dimensionality reduction, we integrated principal component analysis (PCA) and t-distributed stochastic neighbor embedding (t-SNE) to capture dominant variations and reveal intricate structures, respectively. Additionally, we employed the Faster Region-based Convolutional Neural Network (Faster R–CNN) to accurately localize ablation areas. The two-stage detection process of Faster R–CNN, along with the choice of dimensionality reduction technique and data modality, significantly influenced the performance in detecting ablation areas. The evaluation of the ablation detection on an independent test set demonstrated a mean average precision of approximately 0.74, which validates the generalization ability of the models. In the segmentation component, the Mean Shift algorithm showed high quality segmentation without manual cluster definition. Our results prove that the integration of PCA, t-SNE, and Faster R–CNN enables improved interpretation of hyperspectral data, leading to the development of reliable ablation detection and segmentation systems. © 2024 The Authors