Learning Better Registration to Learn Better Few-Shot Medical Image Segmentation: Authenticity, Diversity, and Robustness

被引:25
作者
He, Yuting [1 ,2 ]
Ge, Rongjun [3 ]
Qi, Xiaoming [1 ,2 ]
Chen, Yang [4 ,5 ]
Wu, Jiasong [4 ,5 ]
Coatrieux, Jean-Louis [6 ,7 ,8 ]
Yang, Guanyu [4 ,5 ]
Li, Shuo [9 ,10 ]
机构
[1] Southeast Univ, Lab Image Sci & Technol, Nanjing 210096, Peoples R China
[2] Southeast Univ, Key Lab Comp Network & Informat Integrat, Nanjing 210096, Peoples R China
[3] Nanjing Univ Aeronaut & Astronaut, Coll Comp Sci & Technol, Nanjing 211106, Peoples R China
[4] Southeast Univ, Jiangsu Prov Joint Int Res Lab Med Informat Proc, Key Lab Comp Network & Informat Integrat, Minist Educ,Lab Image Sci & Technol, Nanjing 210096, Peoples R China
[5] Southeast Univ, Ctr Rech Informat Biomedicale Sino Francais CRIBs, Nanjing 210096, Peoples R China
[6] Southeast Univ, Jiangsu Prov Joint Int Res Lab Med Informat Proc, Nanjing 210096, Peoples R China
[7] Southeast Univ, Ctr Rech Informat Biomed SinoFrancais CRIBs, Nanjing 210096, Peoples R China
[8] Univ Rennes, INSERM, LTSI UMR1099, F-35000 Rennes, France
[9] Case Western Reserve Univ, Dept Biomed Engn, Cleveland, OH 44106 USA
[10] Case Western Reserve Univ, Dept Comp & Data Sci, Cleveland, OH 44106 USA
关键词
Image segmentation; Biomedical imaging; Robustness; Task analysis; Distortion; Costs; Strain; Atlas; deep learning (DL); few-shot learning; generation; medical image registration (MIR); medical image segmentation (MIS);
D O I
10.1109/TNNLS.2022.3190452
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this work, we address the task of few-shot medical image segmentation (MIS) with a novel proposed framework based on the learning registration to learn segmentation (LRLS) paradigm. To cope with the limitations of lack of authenticity, diversity, and robustness in the existing LRLS frameworks, we propose the better registration better segmentation (BRBS) framework with three main contributions that are experimentally shown to have substantial practical merit. First, we improve the authenticity in the registration-based generation program and propose the knowledge consistency constraint strategy that constrains the registration network to learn according to the domain knowledge. It brings the semantic-aligned and topology-preserved registration, thus allowing the generation program to output new data with great space and style authenticity. Second, we deeply studied the diversity of the generation process and propose the space-style sampling program, which introduces the modeling of the transformation path of style and space change between few atlases and numerous unlabeled images into the generation program. Therefore, the sampling on the transformation paths provides much more diverse space and style features to the generated data effectively improving the diversity. Third, we first highlight the robustness in the learning of segmentation in the LRLS paradigm and propose the mix misalignment regularization, which simulates the misalignment distortion and constrains the network to reduce the fitting degree of misaligned regions. Therefore, it builds regularization for these regions improving the robustness of segmentation learning. Without any bells and whistles, our approach achieves a new state-of-the-art performance in few-shot MIS on two challenging tasks that outperform the existing LRLS-based few-shot methods. We believe that this novel and effective framework will provide a powerful few-shot benchmark for the field of medical image and efficiently reduce the costs of medical image research. All of our code will be made publicly available online.
引用
收藏
页码:2588 / 2601
页数:14
相关论文
共 52 条
[1]  
[Anonymous], 2016, 3D U NET LEARNING DE
[2]   A fast diffeomorphic image registration algorithm [J].
Ashburner, John .
NEUROIMAGE, 2007, 38 (01) :95-113
[3]   Symmetric diffeomorphic image registration with cross-correlation: Evaluating automated labeling of elderly and neurodegenerative brain [J].
Avants, B. B. ;
Epstein, C. L. ;
Grossman, M. ;
Gee, J. C. .
MEDICAL IMAGE ANALYSIS, 2008, 12 (01) :26-41
[4]   SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation [J].
Badrinarayanan, Vijay ;
Kendall, Alex ;
Cipolla, Roberto .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (12) :2481-2495
[5]   VoxelMorph: A Learning Framework for Deformable Medical Image Registration [J].
Balakrishnan, Guha ;
Zhao, Amy ;
Sabuncu, Mert R. ;
Guttag, John ;
Dalca, Adrian, V .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2019, 38 (08) :1788-1800
[6]   An Unsupervised Learning Model for Deformable Medical Image Registration [J].
Balakrishnan, Guha ;
Zhao, Amy ;
Sabuncu, Mert R. ;
Guttag, John ;
Dalca, Adrian V. .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :9252-9260
[7]   Multi-task Attention-Based Semi-supervised Learning for Medical Image Segmentation [J].
Chen, Shuai ;
Bortsova, Gerda ;
Juarez, Antonio Garcia-Uceda ;
van Tulder, Gijs ;
de Bruijne, Marleen .
MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2019, PT III, 2019, 11766 :457-465
[8]   Semi-Supervised Semantic Segmentation with Cross Pseudo Supervision [J].
Chen, Xiaokang ;
Yuan, Yuhui ;
Zeng, Gang ;
Wang, Jingdong .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :2613-2622
[9]  
Ding YH, 2021, AAAI CONF ARTIF INTE, V35, P1246
[10]   Spatial Warping Network for 3D Segmentation of the Hippocampus in MR Images [J].
Dinsdale, Nicola K. ;
Jenkinson, Mark ;
Namburete, Ana I. L. .
MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2019, PT III, 2019, 11766 :284-291