DINOV2 BASED SELF SUPERVISED LEARNING FOR FEW SHOT MEDICAL IMAGE SEGMENTATION

被引:2
作者
Ayzenberg, Lev [1 ]
Giryes, Raja [1 ]
Greenspan, Hayit [1 ,2 ]
机构
[1] Tel Aviv Univ, Fac Engn, Tel Aviv, Israel
[2] Icahn Sch Med Mt Sinai, New York, NY USA
来源
IEEE INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING, ISBI 2024 | 2024年
基金
以色列科学基金会;
关键词
Self Supervised Learning; Few Shot learning; Medical Image Segmentation; Deep Learning;
D O I
10.1109/ISBI56570.2024.10635439
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Deep learning models have emerged as the cornerstone of medical image segmentation, but their efficacy hinges on the availability of extensive manually labeled datasets and their adaptability to unforeseen categories remains a challenge. Few-shot segmentation (FSS) offers a promising solution by endowing models with the capacity to learn novel classes from limited labeled examples. A leading method for FSS is ALPNet, which compares features between the query image and the few available support segmented images. A key question about using ALPNet is how to design its features. In this work, we delve into the potential of using features from DINOv2, which is a foundational self-supervised learning model in computer vision. Leveraging the strengths of ALPNet and harnessing the feature extraction capabilities of DINOv2, we present a novel approach to few-shot segmentation that not only enhances performance but also paves the way for more robust and adaptable medical image analysis.
引用
收藏
页数:5
相关论文
共 16 条
[1]   DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs [J].
Chen, Liang-Chieh ;
Papandreou, George ;
Kokkinos, Iasonas ;
Murphy, Kevin ;
Yuille, Alan L. .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (04) :834-848
[2]   Masked-attention Mask Transformer for Universal Image Segmentation [J].
Cheng, Bowen ;
Misra, Ishan ;
Schwing, Alexander G. ;
Kirillov, Alexander ;
Girdhar, Rohit .
2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, :1280-1289
[3]   Few-shot Medical Image Segmentation with Cycle-resemblance Attention [J].
Ding, Hao ;
Sun, Changchang ;
Tang, Hao ;
Cai, Dawen ;
Yan, Yan .
2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2023, :2487-2496
[4]  
Dosovitskiy A., 2020, arXiv, V2010, P11929, DOI [10.48550/arXiv.2010.11929Focustolearnmore, DOI 10.48550/ARXIV.2010.11929FOCUSTOLEARNMORE]
[5]   Efficient graph-based image segmentation [J].
Felzenszwalb, PF ;
Huttenlocher, DP .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2004, 59 (02) :167-181
[6]  
Gui Jie, 2023, ARXIV
[7]  
Hu Edward J, 2021, arXiv
[8]  
Huang Y, 2023, ARXIV
[9]   CHAOS Challenge- combined (CT-MR) healthy abdominal organ segmentation [J].
Kavur, A. Emre ;
Gezer, N. Sinem ;
Baris, Mustafa ;
Aslan, Sinem ;
Conze, Pierre-Henri ;
Groza, Vladimir ;
Duc Duy Pham ;
Chatterjee, Soumick ;
Ernst, Philipp ;
Ozkan, Savas ;
Baydar, Bora ;
Lachinov, Dmitry ;
Han, Shuo ;
Pauli, Josef ;
Isensee, Fabian ;
Perkonigg, Matthias ;
Sathish, Rachana ;
Rajan, Ronnie ;
Sheet, Debdoot ;
Dovletov, Gurbandurdy ;
Speck, Oliver ;
Nurnberger, Andreas ;
Maier-Hein, Klaus H. ;
Akar, Gozde Bozdagi ;
Unal, Gozde ;
Dicle, Oguz ;
Selver, M. Alper .
MEDICAL IMAGE ANALYSIS, 2021, 69
[10]  
Landman B., 2015, Proc MICCAI Multi-Atlas Labeling Beyond Cranial Vault-Workshop Challenge (Munich, Germany), P12, DOI [10.7303/syn3193805, DOI 10.7303/SYN3193805]