RESIDUAL SWIN TRANSFORMER UNET WITH CONSISTENCY REGULARIZATION FOR AUTOMATIC BREAST ULTRASOUND TUMOR SEGMENTATION

被引:5
作者
Zhuang, Xianwei [1 ]
Zhu, Xiner [1 ]
Hu, Haoji [1 ]
Yao, Jincao [2 ]
Li, Wei [2 ]
Yang, Chen [2 ]
Wang, Liping [2 ]
Feng, Na [2 ]
Xu, Dong [2 ]
机构
[1] Zhejiang Univ, Coll Informat Sci & Elect Engn, Hangzhou, Peoples R China
[2] Univ Chinese Acad Sci, Canc Hosp, Zhejiang Canc Hosp, Hangzhou, Peoples R China
来源
2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP | 2022年
关键词
Automatic Breast Ultrasound; Medical Image Segmentation; Consistency Regularization; Transformer; Convolutional Neural Networks; CLASSIFICATION;
D O I
10.1109/ICIP46576.2022.9897941
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Automatic Breast Ultrasound (ABUS) image segmentation is of great significance for breast cancer diagnosis and treatment. However, similar to most medical datasets, ABUS image datasets are often small-scale and seriously imbalanced, which makes ABUS image segmentation become a challenge. To solve this problem, we propose the Residual Swin Transformer Unet with Consistency Regularization (RSTUnet-CR) which can make full use of non-lesion and unlabeled images for high-precision tumor segmentation on ABUS images. We design a consistency-regularization decoder to reconstruct the input image, which can learn well from non-lesion and unlabeled data. The reconstruction task makes the model more suitable for the imbalanced medical image datasets. In addition, observing that the ABUS images have global semantic correlation, we establish long-distance dependence of images by the residual Swin Transformer block to improve segmentation performance. We evaluate our method on the ABUS dataset collected from 256 subjects and demonstrate the superiority of the proposed method over other state-of-the-art methods in this imbalanced dataset.
引用
收藏
页码:3071 / 3075
页数:5
相关论文
共 20 条
  • [1] Semi-supervised Medical Image Segmentation via Learning Consistency Under Transformations
    Bortsova, Gerda
    Dubost, Florian
    Hogeweg, Laurens
    Katramados, Ioannis
    de Bruijne, Marleen
    [J]. MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2019, PT VI, 2019, 11769 : 810 - 818
  • [2] Cao Hu, 2021, ARXIV210505537
  • [3] Chen J., 2021, arXiv preprint arXiv:2102.04306
  • [4] Automated breast cancer detection and classification using ultrasound images: A survey
    Cheng, H. D.
    Shan, Juan
    Ju, Wen
    Guo, Yanhui
    Zhang, Ling
    [J]. PATTERN RECOGNITION, 2010, 43 (01) : 299 - 317
  • [5] ResUNet-a: A deep learning framework for semantic segmentation of remotely sensed data
    Diakogiannis, Foivos, I
    Waldner, Francois
    Caccetta, Peter
    Wu, Chen
    [J]. ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2020, 162 (162) : 94 - 114
  • [6] Kang B., 2019, P INT C LEARN REPR I
  • [7] Kingma Diederik P., 2013, ARXIV PREPRINT ARXIV
  • [8] Artificial intelligence in breast imaging
    Le, E. P., V
    Wang, Y.
    Huang, Y.
    Hickman, S.
    Gilbert, F. J.
    [J]. CLINICAL RADIOLOGY, 2019, 74 (05) : 357 - 366
  • [9] Breast tumor segmentation in 3D automatic breast ultrasound using Mask scoring R-CNN
    Lei, Yang
    He, Xiuxiu
    Yao, Jincao
    Wang, Tonghe
    Wang, Lijing
    Li, Wei
    Curran, Walter J.
    Liu, Tian
    Xu, Dong
    Yang, Xiaofeng
    [J]. MEDICAL PHYSICS, 2021, 48 (01) : 204 - 214
  • [10] SwinIR: Image Restoration Using Swin Transformer
    Liang, Jingyun
    Cao, Jiezhang
    Sun, Guolei
    Zhang, Kai
    Van Gool, Luc
    Timofte, Radu
    [J]. 2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW 2021), 2021, : 1833 - 1844