EPT-Net: Edge Perception Transformer for 3D Medical Image Segmentation

被引:15
作者
Yang, Jingyi [1 ]
Jiao, Licheng [1 ]
Shang, Ronghua [1 ]
Liu, Xu [1 ]
Li, Ruiyang [2 ]
Xu, Longchang [2 ]
机构
[1] Xidian Univ, Sch Artificial Intelligence, Key Lab Intelligent Percept & Image Understanding, Minist Educ China, Xian 710071, Peoples R China
[2] Xidian Univ, Sch Comp Sci & Technol, Xian 710071, Peoples R China
基金
中国国家自然科学基金;
关键词
Medical image segmentation; convolu-tional neural networks; transformer; attention mechanism; ARCHITECTURE; ATTENTION;
D O I
10.1109/TMI.2023.3278461
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
The convolutional neural network has achieved remarkable results in most medical image seg- mentation applications. However, the intrinsic locality of convolution operation has limitations in modeling the long-range dependency. Although the Transformer designed for sequence-to-sequence global prediction was born to solve this problem, it may lead to limited positioning capability due to insufficient low-level detail features. Moreover, low-level features have rich fine-grained information, which greatly impacts edge segmentation decisions of different organs. However, a simple CNN module is difficult to capture the edge information in fine-grained features, and the computational power and memory consumed in processing high-resolution 3D features are costly. This paper proposes an encoder-decoder network that effectively combines edge perception and Transformer structure to segment medical images accurately, called EPT-Net. Under this framework, this paper proposes a Dual Position Transformer to enhance the 3D spatial positioning ability effectively. In addition, as low-level features contain detailed information, we conduct an Edge Weight Guidance module to extract edge information by minimizing the edge information function without adding network parameters. Furthermore, we verified the effectiveness of the proposed method on three datasets, including SegTHOR 2019, Multi-Atlas Labeling Beyond the Cranial Vault and the re-labeled KiTS19 dataset called KiTS19-M by us. The experimental results show that EPT-Net has significantly improved compared with the state-of-the-art medical image segmentation method.
引用
收藏
页码:3229 / 3243
页数:15
相关论文
共 50 条
  • [41] MCT-Net: a multi-branch hybrid CNN-transformer model for medical image segmentation
    Longfeng Shen
    Liangjin Diao
    Rui Peng
    Jiacong Chen
    Zhengtian Lu
    Fangzhen Ge
    Pattern Analysis and Applications, 2025, 28 (2)
  • [42] Edge-Boosted U-Net for 2D Medical Image Segmentation
    Zhao, Renjie
    Chen, Weiting
    Cao, Guitao
    IEEE ACCESS, 2019, 7 : 171214 - 171222
  • [43] 3D Medical image segmentation using parallel transformers
    Yan, Qingsen
    Liu, Shengqiang
    Xu, Songhua
    Dong, Caixia
    Li, Zongfang
    Shi, Javen Qinfeng
    Zhang, Yanning
    Dai, Duwei
    PATTERN RECOGNITION, 2023, 138
  • [44] MS-TCNet: An effective Transformer-CNN combined network using multi-scale feature learning for 3D medical image segmentation
    Ao, Yu
    Shi, Weili
    Ji, Bai
    Miao, Yu
    He, Wei
    Jiang, Zhengang
    COMPUTERS IN BIOLOGY AND MEDICINE, 2024, 170
  • [45] Automated multi-modal Transformer network (AMTNet) for 3D medical images segmentation
    Zheng, Shenhai
    Tan, Jiaxin
    Jiang, Chuangbo
    Li, Laquan
    PHYSICS IN MEDICINE AND BIOLOGY, 2023, 68 (02)
  • [46] UT-MT: A Semi-Supervised Model of Fusion Transformer for 3D Medical Image Segmentation
    Liu, Xianchang
    Liu, Peishun
    Wang, Jinyu
    Wang, Qinshuo
    Guo, Qing
    Tang, Ruichun
    2023 8TH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING AND BIG DATA ANALYTICS, ICCCBDA, 2023, : 190 - 196
  • [47] An effective CNN and Transformer complementary network for medical image segmentation
    Yuan, Feiniu
    Zhang, Zhengxiao
    Fang, Zhijun
    PATTERN RECOGNITION, 2023, 136
  • [48] Advantages of transformer and its application for medical image segmentation: a survey
    Pu, Qiumei
    Xi, Zuoxin
    Yin, Shuai
    Zhao, Zhe
    Zhao, Lina
    BIOMEDICAL ENGINEERING ONLINE, 2024, 23 (01)
  • [49] Coformer: Collaborative Transformer for Medical Image Segmentation
    Gao, Yufei
    Zhang, Shichao
    Zhang, Dandan
    Shi, Yucheng
    Zhao, Guohua
    Shi, Lei
    ADVANCED INTELLIGENT COMPUTING TECHNOLOGY AND APPLICATIONS, PT III, ICIC 2024, 2024, 14864 : 240 - 250
  • [50] Hybrid Transformer and Convolution for Medical Image Segmentation
    Wang, Fan
    Wang, Bo
    2022 INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, COMPUTER VISION AND MACHINE LEARNING (ICICML), 2022, : 156 - 159