Segment Anything in Optical Coherence Tomography: SAM 2 for Volumetric Segmentation of Retinal Biomarkers

被引:1
作者
Kulyabin, Mikhail [1 ]
Zhdanov, Aleksei [2 ]
Pershin, Andrey [3 ]
Sokolov, Gleb [2 ]
Nikiforova, Anastasia [4 ,5 ]
Ronkin, Mikhail [3 ]
Borisov, Vasilii [3 ]
Maier, Andreas [1 ]
机构
[1] Friedrich Alexander Univ Erlangen Nurnberg, Dept Comp Sci, Pattern Recognit Lab, D-91058 Erlangen, Germany
[2] VisioMed AI, Golovinskoe Highway 8-2A, Moscow 125212, Russia
[3] Ural Fed Univ Named First President Russia B N Yel, Engn Sch Informat Technol Telecommun & Control Sys, Ekaterinburg 620002, Russia
[4] Ophthalmosurgery Clin Professorskaya Plus, Vostochnaya 30, Ekaterinburg 620075, Russia
[5] Ural State Med Univ, Prevent & Family Med, Repina 3, Ekaterinburg 620028, Russia
来源
BIOENGINEERING-BASEL | 2024年 / 11卷 / 09期
关键词
OCT; segmentation; SAM; MedSAM; AMD; DME; retina;
D O I
10.3390/bioengineering11090940
中图分类号
Q81 [生物工程学(生物技术)]; Q93 [微生物学];
学科分类号
071005 ; 0836 ; 090102 ; 100705 ;
摘要
Optical coherence tomography (OCT) is a non-invasive imaging technique widely used in ophthalmology for visualizing retinal layers, aiding in the early detection and monitoring of retinal diseases. OCT is useful for detecting diseases such as age-related macular degeneration (AMD) and diabetic macular edema (DME), which affect millions of people globally. Over the past decade, the area of application of artificial intelligence (AI), particularly deep learning (DL), has significantly increased. The number of medical applications is also rising, with solutions from other domains being increasingly applied to OCT. The segmentation of biomarkers is an essential problem that can enhance the quality of retinal disease diagnostics. For 3D OCT scans, AI is beneficial since manual segmentation is very labor-intensive. In this paper, we employ the new SAM 2 and MedSAM 2 for the segmentation of OCT volumes for two open-source datasets, comparing their performance with the traditional U-Net. The model achieved an overall Dice score of 0.913 and 0.902 for macular holes (MH) and intraretinal cysts (IRC) on OIMHS and 0.888 and 0.909 for intraretinal fluid (IRF) and pigment epithelial detachment (PED) on the AROI dataset, respectively.
引用
收藏
页数:13
相关论文
共 42 条
  • [1] Nucleus segmentation across imaging experiments: the 2018 Data Science Bowl
    Caicedo, Juan C.
    Goodman, Allen
    Karhohs, Kyle W.
    Cimini, Beth A.
    Ackerman, Jeanelle
    Haghighi, Marzieh
    Heng, CherKeng
    Becker, Tim
    Minh Doan
    McQuin, Claire
    Rohban, Mohammad
    Singh, Shantanu
    Carpenter, Anne E.
    [J]. NATURE METHODS, 2019, 16 (12) : 1247 - +
  • [2] Daanouni O., 2024, Multimed Tools Appl, DOI [10.1007/s11042-024-19514-z, DOI 10.1007/S11042-024-19514-Z]
  • [3] de S Quirino-Makarczyk L., 2021, Recent Advances and New Perspectives in Managing Macular Degeneration
  • [4] Dosovitskiy A, 2021, Arxiv, DOI arXiv:2010.11929
  • [5] Adapting Segment Anything Model (SAM) for Retinal OCT
    Fazekas, Botond
    Morano, Jose
    Lachinov, Dmitrii
    Aresta, Guilherme
    Bogunovic, Hrvoje
    [J]. OPHTHALMIC MEDICAL IMAGE ANALYSIS, OMIA 2023, 2023, 14096 : 92 - 101
  • [6] A generalizable approach based on the U-Net model for automatic intraretinal cyst segmentation in SD-OCT images
    Ganjee, Razieh
    Moghaddam, Mohsen Ebrahimi
    Nourinia, Ramin
    [J]. INTERNATIONAL JOURNAL OF IMAGING SYSTEMS AND TECHNOLOGY, 2023, 33 (05) : 1647 - 1660
  • [7] An unsupervised hierarchical approach for automatic intra-retinal cyst segmentation in spectral-domain optical coherence tomography images
    Ganjee, Razieh
    Moghaddam, Mohsen Ebrahimi
    Nourinia, Ramin
    [J]. MEDICAL PHYSICS, 2020, 47 (10) : 4872 - 4884
  • [8] A two-stage CNN model for the classification and severity analysis of retinal and choroidal diseases in OCT images
    George N.
    Shine L.
    N A.
    Abraham B.
    Ramachandran S.
    [J]. International Journal of Intelligent Networks, 2024, 5 : 10 - 18
  • [9] Masked Autoencoders Are Scalable Vision Learners
    He, Kaiming
    Chen, Xinlei
    Xie, Saining
    Li, Yanghao
    Dollar, Piotr
    Girshick, Ross
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 15979 - 15988
  • [10] OPTICAL COHERENCE TOMOGRAPHY
    HUANG, D
    SWANSON, EA
    LIN, CP
    SCHUMAN, JS
    STINSON, WG
    CHANG, W
    HEE, MR
    FLOTTE, T
    GREGORY, K
    PULIAFITO, CA
    FUJIMOTO, JG
    [J]. SCIENCE, 1991, 254 (5035) : 1178 - 1181