Few-shot Medical Image Segmentation with Cycle-resemblance Attention

被引:36
作者
Ding, Hao [1 ]
Sun, Changchang [1 ]
Tang, Hao [2 ]
Cai, Dawen [3 ]
Yan, Yan [1 ]
机构
[1] IIT, Dept Comp Sci, Chicago, IL 60616 USA
[2] Swiss Fed Inst Technol, Comp Vis Lab, Zurich, Switzerland
[3] Univ Michigan, Dept Cell & Dev Biol, Ann Arbor, MI 48109 USA
来源
2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV) | 2023年
基金
美国国家科学基金会; 美国国家卫生研究院;
关键词
CONVOLUTIONAL NEURAL-NETWORKS; ANNOTATION;
D O I
10.1109/WACV56688.2023.00252
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recently, due to the increasing requirements of medical imaging applications and the professional requirements of annotating medical images, few-shot learning has gained increasing attention in the medical image semantic segmentation field. To perform segmentation with limited number of labeled medical images, most existing studies use Prototypical Networks (PN) and have obtained compelling success. However, these approaches overlook the query imagefeatures extracted from the proposed representation network, failing to preserving the spatial connection between query and support images. In this paper, we propose a novel self-supervised few-shot medical image segmentation network and introduce a novel Cycle-Resemblance Attention (CRA) module to fully leverage the pixel-wise relation between query and support medical images. Notably, we first line up multiple attention blocks to refine more abundant relation information. Then, we present CRAPNet by integrating the CRA module with a classic prototype network, where pixel-wise relations between query and support features are well recaptured for segmentation. Extensive experiments on two different medical image datasets, e.g., abdomen MRI and abdomen CT, demonstrate the superiority of our model over existing state-of-the-art methods.
引用
收藏
页码:2487 / 2496
页数:10
相关论文
共 43 条
[1]  
Bankman Isaac, 2008, HDB MED IMAGE PROCES
[2]  
Bennett Landman, 2015, MICCAI MULTI ATLAS L
[3]   A non-local algorithm for image denoising [J].
Buades, A ;
Coll, B ;
Morel, JM .
2005 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOL 2, PROCEEDINGS, 2005, :60-65
[4]   A survey on active learning and human-in-the-loop deep learning for medical image analysis [J].
Budd, Samuel ;
Robinson, Emma C. ;
Kainz, Bernhard .
MEDICAL IMAGE ANALYSIS, 2021, 71
[5]   Automatic medical image annotation in ImageCLEF 2007: Overview, results, and discussion [J].
Deselaers, Thomas ;
Deserno, Thomas M. ;
Mueller, Henning .
PATTERN RECOGNITION LETTERS, 2008, 29 (15) :1988-1995
[6]   Medical image processing on the GPU - Past, present and future [J].
Eklund, Anders ;
Dufort, Paul ;
Forsberg, Daniel ;
LaConte, Stephen M. .
MEDICAL IMAGE ANALYSIS, 2013, 17 (08) :1073-1094
[7]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[8]  
He Kaiming, 2015, DEEP RESIDUAL LEARNI
[9]   Deep Learning Techniques for Medical Image Segmentation: Achievements and Challenges [J].
Hesamian, Mohammad Hesam ;
Jia, Wenjing ;
He, Xiangjian ;
Kennedy, Paul .
JOURNAL OF DIGITAL IMAGING, 2019, 32 (04) :582-596
[10]   nnU-Net: a self-configuring method for deep learning-based biomedical image segmentation [J].
Isensee, Fabian ;
Jaeger, Paul F. ;
Kohl, Simon A. A. ;
Petersen, Jens ;
Maier-Hein, Klaus H. .
NATURE METHODS, 2021, 18 (02) :203-+