SAM-OCTA: Prompting segment-anything for OCTA image segmentation

被引:0
作者
Chen, Xinrun [1 ]
Wang, Chengliang [1 ]
Ning, Haojian [1 ]
Li, Shiying [2 ]
Shen, Mei [2 ]
机构
[1] Chongqing Univ, Coll Comp Sci, 174 Shazheng St, Chongqing 400044, Peoples R China
[2] Xiamen Univ, Xiangan Hosp, 2000 Xiangan East Rd, Xiamen 361104, Peoples R China
关键词
Optical coherence tomography angiography; Image segmentation; Model fine-tuning; Prompt point; NET;
D O I
10.1016/j.bspc.2025.107698
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Detailed analysis of a local specific biomarker in optical coherence tomography angiography (OCTA) images is essential for medical diagnosis, yet current methods primarily focus on global segmentation, such as of retinal vessel (RV) network. We propose SAM-OCTA, which fine-tunes the Segment Anything Model (SAM) with low- rank adaptation (LoRA) for segmentation tasks in OCTA. Our method enhances the semantic comprehension and prompt mechanism of SAM for OCTA en-face images and achieves a more flexible segmentation approach. The experiments explore the impact of prompt points with both global and local segmentation modes with the OCTA-500 and ROSE-O datasets, using random selection and special annotation prompt generation strategies. Considering practical usage, we evaluate model feasibility at smaller scales and demonstrate the necessity of fine-tuning. Comprehensive experiments demonstrate that SAM-OCTA achieves state-of-the-art performance in RV and FAZ segmentation and excels in artery-vein and localized single-vessel segmentation. The code is available at https://github.com/ShellRedia/SAM-OCTA-extend.
引用
收藏
页数:20
相关论文
共 64 条
  • [1] Lains I., Et al., Retinal applications of swept source optical coherence tomography (OCT) and optical coherence tomography angiography (OCTA), Prog. Retin. Eye Res., 84, (2021)
  • [2] Wang Y., Et al., A deep learning-based quality assessment and segmentation system with a large-scale benchmark dataset for optical coherence tomographic angiography image, (2021)
  • [3] Liang Z., Et al., Foveal avascular zone segmentation of OCTA images using deep learning approach with unsupervised vessel segmentation, ICASSP 2021-2021 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP, pp. 1200-1204, (2021)
  • [4] Lopez-Varela E., Et al., Fully automatic segmentation and monitoring of choriocapillaris flow voids in OCTA images, Comput. Med. Imaging Graph., 104, (2023)
  • [5] Hu K., Et al., Joint-seg: Treat foveal avascular zone and retinal vessel segmentation in octa images as a joint task, IEEE Trans. Instrum. Meas., 71, pp. 1-13, (2022)
  • [6] Li W., Et al., RPS-Net: An effective retinal image projection segmentation network for retinal vessels and foveal avascular zone based on OCTA data, Med. Phys., 49, 6, pp. 3830-3844, (2022)
  • [7] Vali M., Et al., CNV-Net: Segmentation, classification and activity score measurement of choroidal neovascularization (CNV) using optical coherence tomography angiography (OCTA), Diagnostics, 13, 7, (2023)
  • [8] Meiburger K.M., Et al., Automatic segmentation and classification methods using optical coherence tomography angiography (OCTA): a review and handbook, Appl. Sci., 11, 20, (2021)
  • [9] Tran T.-O., Et al., Omics-based deep learning approaches for lung cancer decision-making and therapeutics development, Briefings Funct. Genom., 23, 3, pp. 181-192, (2024)
  • [10] Le N.Q.K., Hematoma expansion prediction: still navigating the intersection of deep learning and radiomics, Eur. Radiol., pp. 1-3, (2024)