Multimodal Neural Network Analysis of Raman Spectra and Dermoscopic Images of Skin Tumors

被引：0
作者：
I. A. Matveeva [1 ]
机构：
[1] Samara National Research University, Samara
来源：
Bulletin of the Russian Academy of Sciences: Physics | 2024年 / 88卷 / Suppl 3期
关键词：
convolutional neural network; dermatoscopy; multimodal analysis; Raman spectroscopy; skin neoplasm;
D O I：
10.1134/S1062873824709905
中图分类号：
学科分类号：
摘要：
The research is devoted to the development of a method for identifying skin tumors based on multimodal joint analysis of Raman scattering data and dermatoscopic images. Experimental skin Raman spectra were recorded using a portable setup that includes a laser source with a central wavelength of 785 nm. The spectra were recorded in the range from 792 to 1874 cm–1. Dermatoscopic images of skin neoplasms were obtained using a digital dermatoscope. Machine learning methods, in particular, convolutional neural networks, were used to analyze the registered data. The classification model for malignant melanoma and benign pigmented neoplasms has shown an increase in classification accuracy compared to the analysis of Raman spectra or dermatoscopic images alone. As a result, combined multimodal method for diagnosing skin cancer, which simultaneously takes into account both specific spectral features of neoplasms and spatial inhomogeneities in the distribution of absorbance, has been proposed. The studied approaches to the analysis of optical biopsy data can be further used as part of the software for automated screening diagnostics of skin pathologies in order to detect neoplasms at an early stage of development. © Pleiades Publishing, Ltd. 2024.
引用
收藏
页码：S394 / S398
页数：4
相关论文
共 23 条
  • [11] Esteva A., Kuprel B., Novoa R.A., Ko J., Swetter S.M., Blau H.M., Thrun S., Nature, 542, (2017)
  • [12] Long G.V., Swetter S.M., Menzies A.M., Gershenwald J.E., Scolyer R.A., Lancet, 402, (2023)
  • [13] Rey-Barroso L., Pena-Gutierrez S., Yanez C., Burgos-Fernandez F.J., Vilaseca M., Royo S., Sensors, 21, (2021)
  • [14] Kassem M.A., Hosny K.M., Damasevicius R., Eltoukhy M.M., Diagnostics, 11, (2021)
  • [15] Bratchenko I.A., Bratchenko L.A., Khristoforova Y.A., Moryatov A.A., Kozlov S.V., Zakharov V.P., Comput. Methods Programs Biomed, 219, (2022)
  • [16] Tuchin V.V., Popp J., Zakharov V., Multimodal Optical Diagnostics of Cancer, (2020)
  • [17] Codella N., Rotemberg V., Tschandl P., Celebi M.E., Dusza S., Gutman D., Helba B., Kalloo A., Liopyris K., Marchetti M., Kittler H., Halpern A., (2019)
  • [18] Tschandl P., Rosendahl C., Kittler H., Sci. Data, 5, (2018)
  • [19] Gu J., Wang Z., Kuen J., Ma L., Shahroudy A., Shuai B., Liu T., Wang X., Wang G., Cai J., Chen T., Pattern Recognit, 77, (2018)
  • [20] Li Z., Liu F., Yang W., Peng S., Zhou J., IEEE Trans. Neural Netw. Learn. Syst, 33, (2021)
123