EPT-Net: Edge Perception Transformer for 3D Medical Image Segmentation

被引:15
作者
Yang, Jingyi [1 ]
Jiao, Licheng [1 ]
Shang, Ronghua [1 ]
Liu, Xu [1 ]
Li, Ruiyang [2 ]
Xu, Longchang [2 ]
机构
[1] Xidian Univ, Sch Artificial Intelligence, Key Lab Intelligent Percept & Image Understanding, Minist Educ China, Xian 710071, Peoples R China
[2] Xidian Univ, Sch Comp Sci & Technol, Xian 710071, Peoples R China
基金
中国国家自然科学基金;
关键词
Medical image segmentation; convolu-tional neural networks; transformer; attention mechanism; ARCHITECTURE; ATTENTION;
D O I
10.1109/TMI.2023.3278461
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
The convolutional neural network has achieved remarkable results in most medical image seg- mentation applications. However, the intrinsic locality of convolution operation has limitations in modeling the long-range dependency. Although the Transformer designed for sequence-to-sequence global prediction was born to solve this problem, it may lead to limited positioning capability due to insufficient low-level detail features. Moreover, low-level features have rich fine-grained information, which greatly impacts edge segmentation decisions of different organs. However, a simple CNN module is difficult to capture the edge information in fine-grained features, and the computational power and memory consumed in processing high-resolution 3D features are costly. This paper proposes an encoder-decoder network that effectively combines edge perception and Transformer structure to segment medical images accurately, called EPT-Net. Under this framework, this paper proposes a Dual Position Transformer to enhance the 3D spatial positioning ability effectively. In addition, as low-level features contain detailed information, we conduct an Edge Weight Guidance module to extract edge information by minimizing the edge information function without adding network parameters. Furthermore, we verified the effectiveness of the proposed method on three datasets, including SegTHOR 2019, Multi-Atlas Labeling Beyond the Cranial Vault and the re-labeled KiTS19 dataset called KiTS19-M by us. The experimental results show that EPT-Net has significantly improved compared with the state-of-the-art medical image segmentation method.
引用
收藏
页码:3229 / 3243
页数:15
相关论文
共 50 条
  • [21] D-former: a U-shaped Dilated Transformer for 3D medical image segmentation
    Yixuan Wu
    Kuanlun Liao
    Jintai Chen
    Jinhong Wang
    Danny Z. Chen
    Honghao Gao
    Jian Wu
    Neural Computing and Applications, 2023, 35 : 1931 - 1944
  • [22] SegMAE-Net: A Hybrid Method Using Masked Autoencoders for Consistent 3D Medical Image Segmentation
    Liaw, Zheng Kai
    Das, Ankit
    Hussain, Shaista
    Yang, Feng
    Liu, Yong
    Goh, Rick Siow Mong
    2024 IEEE CONFERENCE ON ARTIFICIAL INTELLIGENCE, CAI 2024, 2024, : 1272 - 1277
  • [23] SPCTNet: A Series-Parallel CNN and Transformer Network for 3D Medical Image Segmentation
    Yu, Bin
    Zhou, Quan
    Zhang, Xuming
    ARTIFICIAL INTELLIGENCE, CICAI 2023, PT I, 2024, 14473 : 376 - 387
  • [24] MIXED TRANSFORMER U-NET FOR MEDICAL IMAGE SEGMENTATION
    Wang, Hongyi
    Xie, Shiao
    Lin, Lanfen
    Iwamoto, Yutaro
    Han, Xian-Hua
    Chen, Yen-Wei
    Tong, Ruofeng
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 2390 - 2394
  • [25] SFE-TRANSUNET: A TRANSFORMER-BASED U-NET WITH SKIPPED FEATURES ENHANCER FOR MEDICAL IMAGE SEGMENTATION
    Huang, Jianuo
    Lan, Quan
    Deng, Wen
    Huang, Chenxi
    Zhang, Suzhen
    JOURNAL OF MECHANICS IN MEDICINE AND BIOLOGY, 2024, 24 (08)
  • [26] LET-Net: locally enhanced transformer network for medical image segmentation
    Ta, Na
    Chen, Haipeng
    Liu, Xianzhu
    Jin, Nuo
    MULTIMEDIA SYSTEMS, 2023, 29 (06) : 3847 - 3861
  • [27] LET-Net: locally enhanced transformer network for medical image segmentation
    Na Ta
    Haipeng Chen
    Xianzhu Liu
    Nuo Jin
    Multimedia Systems, 2023, 29 (6) : 3847 - 3861
  • [28] EFFICIENT 3D TRANSFORMER WITH CLUSTER-BASED DOMAIN-ADVERSARIAL LEARNING FOR 3D MEDICAL IMAGE SEGMENTATION
    Zhang, Haoran
    Chen, Hao
    2023 IEEE 20TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING, ISBI, 2023,
  • [29] MSA-Net: Multi-scale feature fusion network with enhanced attention module for 3D medical image segmentation
    Wang, Shuo
    Wang, Yuanhong
    Peng, Yanjun
    Chen, Xue
    COMPUTERS & ELECTRICAL ENGINEERING, 2024, 120
  • [30] Low-Contrast Medical Image Segmentation via Transformer and Boundary Perception
    Zhang, Yinglin
    Xi, Ruiling
    Wang, Wei
    Li, Heng
    Hu, Lingxi
    Lin, Huiyan
    Towey, Dave
    Bai, Ruibin
    Fu, Huazhu
    Higashita, Risa
    Liu, Jiang
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2024, 8 (03): : 2297 - 2309