Segmentation Method of Magnetoelectric Brain Image Based on the Transformer and the CNN

被引:0
|
作者
Liu, Xiaoli [1 ]
Cheng, Xiaorong [1 ]
机构
[1] North China Elect Power Univ, Sch Control & Comp Engn, Baoding 071003, Peoples R China
关键词
3D BCS attention mechanism; transformer; multiple models; magnetic resonance imaging; loss function;
D O I
10.3390/info13100445
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
To address the problem of a low accuracy and blurred boundaries in segmenting multi-modal brain tumor images using the TransBTS network, a 3D BCS _T model incorporating a channel space attention mechanism is proposed. Firstly, the TransBTS model hierarchy is increased to obtain more local feature information, and residual basis blocks are added to reduce feature loss. Secondly, downsampling is incorporated into the hybrid attention mechanism to enhance the critical region information extraction. Finally, weighted cross-entropy loss and generalized dice loss are employed to solve the inequality problem in the tumor sample categories. The experimental results show that the whole tumor region WT, the tumor core region TC, and the enhanced tumor region ET are improved by an average of 2.53% in the evaluation metric of the Dice similarity coefficient, compared with the TransBTS network and shortened by an average of 3.14 in the metric of Hausdorff distance 95. Therefore, the 3D BCS _T model can effectively improve the segmentation accuracy and boundary clarity of both the tumor core and the enhanced tumor categories of the small areas.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] HybridCTrm: Bridging CNN and Transformer for Multimodal Brain Image Segmentation
    Sun, Qixuan
    Fang, Nianhua
    Liu, Zhuo
    Zhao, Liang
    Wen, Youpeng
    Lin, Hongxiang
    JOURNAL OF HEALTHCARE ENGINEERING, 2021, 2021
  • [2] CNN Based Transformer for Panoptic Segmentation
    Mao L.
    Ren F.-Z.
    Yang D.-W.
    Zhang R.-B.
    Ruan Jian Xue Bao/Journal of Software, 2023, 34 (07): : 3408 - 3421
  • [3] CONVFORMER: COMBINING CNN AND TRANSFORMER FOR MEDICAL IMAGE SEGMENTATION
    Gu, Pengfei
    Zhang, Yejia
    Wang, Chaoli
    Chen, Danny Z.
    2023 IEEE 20TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING, ISBI, 2023,
  • [4] Multiscale fire image detection method based on CNN and Transformer
    Shengbao Wu
    Buyun Sheng
    Gaocai Fu
    Daode Zhang
    Yuchao Jian
    Multimedia Tools and Applications, 2024, 83 : 49787 - 49811
  • [5] Multiscale fire image detection method based on CNN and Transformer
    Wu, Shengbao
    Sheng, Buyun
    Fu, Gaocai
    Zhang, Daode
    Jian, Yuchao
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 83 (16) : 49787 - 49811
  • [6] Remote Sensing Image Road Segmentation Method Integrating CNN-Transformer and UNet
    Wang, Rui
    Cai, Mingxiang
    Xia, Zixuan
    Zhou, Zhicui
    IEEE ACCESS, 2023, 11 : 144446 - 144455
  • [7] SEGTRANSVAE: HYBRID CNN - TRANSFORMER WITH REGULARIZATION FOR MEDICAL IMAGE SEGMENTATION
    Quan-Dung Pham
    Hai Nguyen-Truong
    Nam Nguyen Phuong
    Nguyen, Khoa N. A.
    Nguyen, Chanh D. T.
    Bui, Trung
    Truong, Steven Q. H.
    2022 IEEE INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (IEEE ISBI 2022), 2022,
  • [8] An effective CNN and Transformer complementary network for medical image segmentation
    Yuan, Feiniu
    Zhang, Zhengxiao
    Fang, Zhijun
    PATTERN RECOGNITION, 2023, 136
  • [9] From CNN to Transformer: A Review of Medical Image Segmentation Models
    Yao, Wenjian
    Bai, Jiajun
    Liao, Wei
    Chen, Yuheng
    Liu, Mengjuan
    Xie, Yao
    JOURNAL OF IMAGING INFORMATICS IN MEDICINE, 2024, 37 (04): : 1529 - 1547
  • [10] SMESwin Unet: Merging CNN and Transformer for Medical Image Segmentation
    Wang, Ziheng
    Min, Xiongkuo
    Shi, Fangyu
    Jin, Ruinian
    Nawrin, Saida S.
    Yu, Ichen
    Nagatomi, Ryoichi
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2022, PT V, 2022, 13435 : 517 - 526