Self-Supervised Interactive Embedding for One-Shot Organ Segmentation

被引:9
|
作者
Yang, Yang [1 ]
Wang, Bo [2 ,3 ]
Zhang, Dingwen [4 ,5 ,6 ]
Yuan, Yixuan [7 ]
Yan, Qingsen [8 ]
Zhao, Shijie [1 ]
You, Zheng [9 ]
Han, Junwei [5 ,6 ]
机构
[1] Northwestern Polytech Univ, Sch Automat, Xian, Peoples R China
[2] Tsinghua Univ, Dept Precis Instrument, State Key Lab Precis Measurement Technol & Instrum, Beijing, Peoples R China
[3] Technology Ltd, Beijing Jingzhen Med, Beijing, Peoples R China
[4] Fourth Mil Med Univ, Xijing Hosp, Dept Clin Immunol, Xian 710032, Peoples R China
[5] Hefei Comprehens Natl Sci Ctr, Inst Artificial Intelligence, Hefei 230088, Peoples R China
[6] Northwestern Polytech Univ, Sch Automat, Brain & Artificial Intelligence Lab, Xian 710072, Peoples R China
[7] Chinese Univ Hong Kong, Dept Elect Engn, Hong Kong, Peoples R China
[8] Northwestern Polytech Univ, Sch Comp Sci, Xian, Peoples R China
[9] Tsinghua Univ, Dept Precis Instrument, State Key Lab Precis Measurement Technol & Instrum, Beijing, Peoples R China
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
Image segmentation; Biomedical imaging; Three-dimensional displays; Task analysis; Annotations; Feature extraction; Biological systems; Self-supervised learning; contrastive learning; interactive embedding; co-attention mechanism; one-shot learning; medical image segmentation;
D O I
10.1109/TBME.2023.3265033
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
One-shot organ segmentation (OS2) aims at segmenting the desired organ regions from the input medical imaging data with only one pre-annotated example as the reference. By using the minimal annotation data to facilitate organ segmentation, OS2 receives great attention in the medical image analysis community due to its weak requirement on human annotation. In OS2, one core issue is to explore the mutual information between the support (reference slice) and the query (test slice). Existing methods rely heavily on the similarity between slices, and additional slice allocation mechanisms need to be designed to reduce the impact of the similarity between slices on the segmentation performance. To address this issue, we build a novel support-query interactive embedding (SQIE) module, which is equipped with the channel-wise co-attention, spatial-wise co-attention, and spatial bias transformation blocks to identify "what to look", "where to look", and "how to look" in the input test slice. By combining the three mechanisms, we can mine the interactive information of the intersection area and the disputed area between slices, and establish the feature connection between the target in slices with low similarity. We also propose a self-supervised contrastive learning framework, which transforms knowledge from the physical position to the embedding space to facilitate the self-supervised interactive embedding of the query and support slices. Comprehensive experiments on two large benchmarks demonstrate the superior capacity of the proposed approach when compared with the current alternatives and baseline models.
引用
收藏
页码:2799 / 2808
页数:10
相关论文
共 50 条
  • [1] Self-supervised learning based transformer and convolution hybrid network for one-shot organ segmentation
    Wang, Bo
    Li, Qian
    You, Zheng
    NEUROCOMPUTING, 2023, 527 : 1 - 12
  • [2] Self-Supervised Generative Style Transfer for One-Shot Medical Image Segmentation
    Tomar, Devavrat
    Bozorgtabar, Behzad
    Lortkipanidze, Manana
    Vray, Guillaume
    Rad, Mohammad Saeed
    Thiran, Jean-Philippe
    2022 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2022), 2022, : 1737 - 1747
  • [3] Weakly Supervised One-Shot Segmentation
    Raza, Hasnain
    Ravanbakhsh, Mahdyar
    Klein, Tassilo
    Nabi, Moin
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW), 2019, : 1401 - 1406
  • [4] A Self-Supervised One-Shot Learning Approach for Seismic Noise Reduction
    Pinheiro, Catarina de Nazare Pereira
    Sardinha, Roosevelt de Lima
    Barros, Pablo Machado
    Bulcao, Andre
    Costa, Bruno Vieira
    Evsukoff, Alexandre Goncalves
    APPLIED SCIENCES-BASEL, 2024, 14 (21):
  • [5] Self-Supervised Interactive Image Segmentation
    Shi, Qingxuan
    Li, Yihang
    Di, Huijun
    Wu, Enyi
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (08) : 6797 - 6808
  • [6] SELF-SUPERVISED VQ-VAE FOR ONE-SHOT MUSIC STYLE TRANSFER
    Cifka, Ondrej
    Ozerov, Alexey
    Simsekli, Umut
    Richard, Gael
    2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 96 - 100
  • [7] Rich Embedding Features for One-Shot Semantic Segmentation
    Zhang, Xiaolin
    Wei, Yunchao
    Li, Zhao
    Yan, Chenggang
    Yang, Yi
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (11) : 6484 - 6493
  • [8] Self-supervised assisted multi-task learning network for one-shot defect segmentation with fake defect generation
    Hu, Ziqiang
    Chu, Hao
    Zhang, Yunzhou
    Shan, Dexing
    Shen, You
    PATTERN RECOGNITION LETTERS, 2024, 184 : 89 - 96
  • [9] Self-Supervised Tuning for Few-Shot Segmentation
    Zhu, Kai
    Zhai, Wei
    Cao, Yang
    PROCEEDINGS OF THE TWENTY-NINTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2020, : 1019 - 1025
  • [10] Self-supervised spatial-temporal feature enhancement for one-shot video object detection
    Yao, Xudong
    Yang, Xiaoshan
    NEUROCOMPUTING, 2024, 601