EPT-Net: Edge Perception Transformer for 3D Medical Image Segmentation

被引:15
作者
Yang, Jingyi [1 ]
Jiao, Licheng [1 ]
Shang, Ronghua [1 ]
Liu, Xu [1 ]
Li, Ruiyang [2 ]
Xu, Longchang [2 ]
机构
[1] Xidian Univ, Sch Artificial Intelligence, Key Lab Intelligent Percept & Image Understanding, Minist Educ China, Xian 710071, Peoples R China
[2] Xidian Univ, Sch Comp Sci & Technol, Xian 710071, Peoples R China
基金
中国国家自然科学基金;
关键词
Medical image segmentation; convolu-tional neural networks; transformer; attention mechanism; ARCHITECTURE; ATTENTION;
D O I
10.1109/TMI.2023.3278461
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
The convolutional neural network has achieved remarkable results in most medical image seg- mentation applications. However, the intrinsic locality of convolution operation has limitations in modeling the long-range dependency. Although the Transformer designed for sequence-to-sequence global prediction was born to solve this problem, it may lead to limited positioning capability due to insufficient low-level detail features. Moreover, low-level features have rich fine-grained information, which greatly impacts edge segmentation decisions of different organs. However, a simple CNN module is difficult to capture the edge information in fine-grained features, and the computational power and memory consumed in processing high-resolution 3D features are costly. This paper proposes an encoder-decoder network that effectively combines edge perception and Transformer structure to segment medical images accurately, called EPT-Net. Under this framework, this paper proposes a Dual Position Transformer to enhance the 3D spatial positioning ability effectively. In addition, as low-level features contain detailed information, we conduct an Edge Weight Guidance module to extract edge information by minimizing the edge information function without adding network parameters. Furthermore, we verified the effectiveness of the proposed method on three datasets, including SegTHOR 2019, Multi-Atlas Labeling Beyond the Cranial Vault and the re-labeled KiTS19 dataset called KiTS19-M by us. The experimental results show that EPT-Net has significantly improved compared with the state-of-the-art medical image segmentation method.
引用
收藏
页码:3229 / 3243
页数:15
相关论文
共 50 条
  • [11] D-former: a U-shaped Dilated Transformer for 3D medical image segmentation
    Wu, Yixuan
    Liao, Kuanlun
    Chen, Jintai
    Wang, Jinhong
    Chen, Danny Z.
    Gao, Honghao
    Wu, Jian
    NEURAL COMPUTING & APPLICATIONS, 2023, 35 (02) : 1931 - 1944
  • [12] CT-Net: Asymmetric compound branch Transformer for medical image segmentation
    Zhang, Ning
    Yu, Long
    Zhang, Dezhi
    Wu, Weidong
    Tian, Shengwei
    Kang, Xiaojing
    Li, Min
    NEURAL NETWORKS, 2024, 170 : 298 - 311
  • [13] SEAformer: Selective Edge Aggregation transformer for 2D medical image segmentation
    Li, Jingwen
    Chen, Jilong
    Jiang, Lei
    Li, Ruoyu
    Han, Peilun
    Cheng, Junlong
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2025, 102
  • [14] DAST: Differentiable Architecture Search with Transformer for 3D Medical Image Segmentation
    Yang, Dong
    Xu, Ziyue
    He, Yufan
    Nath, Vishwesh
    Li, Wenqi
    Myronenko, Andriy
    Hatamizadeh, Ali
    Zhao, Can
    Roth, Holger R.
    Xu, Daguang
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2023, PT III, 2023, 14222 : 747 - 756
  • [15] CoTr: Efficiently Bridging CNN and Transformer for 3D Medical Image Segmentation
    Xie, Yutong
    Zhang, Jianpeng
    Shen, Chunhua
    Xia, Yong
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2021, PT III, 2021, 12903 : 171 - 180
  • [16] nnU-Net Revisited: A Call for Rigorous Validation in 3D Medical Image Segmentation
    Isensee, Fabian
    Wald, Tassilo
    Ulrich, Constantin
    Baumgartner, Michael
    Roy, Saikat
    Maier-Hein, Klaus
    Jaeger, Paul F.
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2024, PT IX, 2024, 15009 : 488 - 498
  • [17] HTC-Net: A hybrid CNN-transformer framework for medical image segmentation
    Tang, Hui
    Chen, Yuanbin
    Wang, Tao
    Zhou, Yuanbo
    Zhao, Longxuan
    Gao, Qinquan
    Du, Min
    Tan, Tao
    Zhang, Xinlin
    Tong, Tong
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2024, 88
  • [18] Hybrid 3D Medical Image Segmentation Using CNN and Frequency Transformer Fusion
    Labbihi, Ismayl
    Meslouhi, Othmane El
    Elassad, Zouhair Elamrani Abou
    Benaddy, Mohamed
    Kardouchi, Mustapha
    Akhloufi, Moulay
    ARABIAN JOURNAL FOR SCIENCE AND ENGINEERING, 2024,
  • [19] ETC-Net: an efficient collaborative transformer and convolutional network combining edge constraints for medical image segmentation
    Dang, Lanxue
    Li, Shilong
    Zhang, Wenwen
    Hou, Yan-e
    Liu, Yang
    EVOLVING SYSTEMS, 2025, 16 (02)
  • [20] Effective Global Context Integration for Lightweight 3D Medical Image Segmentation
    Qiao, Qiang
    Qu, Meixia
    Wang, Wenyu
    Jiang, Bin
    Guo, Qiang
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2025, 35 (05) : 4661 - 4674