MMCA-NET: A Multimodal Cross Attention Transformer Network for Nasopharyngeal Carcinoma Tumor Segmentation Based on a Total-Body PET/CT System

被引:5
|
作者
Zhao, Wenjie [1 ,2 ]
Huang, Zhenxing [1 ,2 ]
Tang, Si [3 ]
Li, Wenbo [1 ,2 ]
Gao, Yunlong [1 ,2 ]
Hu, Yingying [3 ]
Fan, Wei [3 ]
Cheng, Chuanli [1 ,2 ]
Yang, Yongfeng [1 ,4 ]
Zheng, Hairong [1 ,4 ]
Liang, Dong [1 ,4 ]
Hu, Zhanli [1 ,4 ]
机构
[1] Chinese Acad Sci, Shenzhen Inst Adv Technol, Lauterbur Res Ctr Biomed Imaging, Shenzhen 518055, Peoples R China
[2] Shenzhen Univ, Coll Comp Sci & Software Engn, Shenzhen 518060, Peoples R China
[3] Sun Yat Sen Univ, Dept Nucl Med, Canc Ctr, Guangzhou 510060, Peoples R China
[4] Chinese Acad Sci, Key Lab Biomed Imaging Sci & Syst, Shenzhen 518055, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Image segmentation; Computed tomography; Transformers; Decoding; Cancer; Deep learning; Nasopharyngeal carcinoma segmentation; multimodal PET/CT; transformer; cross attention;
D O I
10.1109/JBHI.2024.3405993
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Nasopharyngeal carcinoma (NPC) is a malignant tumor primarily treated by radiotherapy. Accurate delineation of the target tumor is essential for improving the effectiveness of radiotherapy. However, the segmentation performance of current models is unsatisfactory due to poor boundaries, large-scale tumor volume variation, and the labor-intensive nature of manual delineation for radiotherapy. In this paper, MMCA-Net, a novel segmentation network for NPC using PET/CT images that incorporates an innovative multimodal cross attention transformer (MCA-Transformer) and a modified U-Net architecture, is introduced to enhance modal fusion by leveraging cross-attention mechanisms between CT and PET data. Our method, tested against ten algorithms via fivefold cross-validation on samples from Sun Yat-sen University Cancer Center and the public HECKTOR dataset, consistently topped all four evaluation metrics with average Dice similarity coefficients of 0.815 and 0.7944, respectively. Furthermore, ablation experiments were conducted to demonstrate the superiority of our method over multiple baseline and variant techniques. The proposed method has promising potential for application in other tasks.
引用
收藏
页码:5447 / 5458
页数:12
相关论文
共 12 条
  • [1] Nasopharyngeal Carcinoma Tumor Segmentation with Multimodal Cross-Attention Transformer on Total-Body uEXPLORER PET/CT System
    Zhao, Wenjie
    Huang, Zhenxing
    Tang, Si
    Hu, Ying-ying
    Fan, Wei
    Li, Wenbo
    Gao, Yunlong
    Yang, Yongfeng
    Liang, Dong
    Hu, Zhanli
    JOURNAL OF NUCLEAR MEDICINE, 2024, 65
  • [2] TG-Net: Combining transformer and GAN for nasopharyngeal carcinoma tumor segmentation based on total-body uEXPLORER PET/CT scanner
    Huang, Zhengyong
    Tang, Si
    Chen, Zixiang
    Wang, Guoshuai
    Shen, Hao
    Zhou, Yun
    Wang, Haining
    Fan, Wei
    Liang, Dong
    Hu, Yingying
    Hu, Zhanli
    COMPUTERS IN BIOLOGY AND MEDICINE, 2022, 148
  • [3] ISA-Net: Improved spatial attention network for PET-CT tumor segmentation
    Huang, Zhengyong
    Zou, Sijuan
    Wang, Guoshuai
    Chen, Zixiang
    Shen, Hao
    Wang, Haiyan
    Zhang, Na
    Zhang, Lu
    Yang, Fan
    Wang, Haining
    Liang, Dong
    Niu, Tianye
    Zhu, Xiaohua
    Hu, Zhanli
    COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE, 2022, 226
  • [4] DMCT-Net: dual modules convolution transformer network for head and neck tumor segmentation in PET/CT
    Wang, Jiao
    Peng, Yanjun
    Guo, Yanfei
    PHYSICS IN MEDICINE AND BIOLOGY, 2023, 68 (11):
  • [5] A spatial squeeze and multimodal feature fusion attention network for multiple tumor segmentation from PET-CT Volumes
    Diao, Zhaoshuo
    Jiang, Huiyan
    Shi, Tianyu
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2023, 121
  • [6] A personal acquisition time regimen of 68Ga-DOTATATE total-body PET/CT in patients with neuroendocrine tumor (NET): a feasibility study
    Jie Xiao
    Haojun Yu
    Xiuli Sui
    Guobing Liu
    Yanyan Cao
    Zhao Yanzhao
    Yiqiu Zhang
    Pengcheng Hu
    Dengfeng Cheng
    Hongcheng Shi
    Cancer Imaging, 22
  • [7] A personal acquisition time regimen of 68Ga-DOTATATE total-body PET/CT in patients with neuroendocrine tumor (NET): a feasibility study
    Xiao, Jie
    Yu, Haojun
    Sui, Xiuli
    Liu, Guobing
    Cao, Yanyan
    Yanzhao, Zhao
    Zhang, Yiqiu
    Hu, Pengcheng
    Cheng, Dengfeng
    Shi, Hongcheng
    CANCER IMAGING, 2022, 22 (01)
  • [8] MRLA-Net: A tumor segmentation network embedded with a multiple receptive-field lesion attention module in PET-CT images?
    Zhou, Yang
    Jiang, Huiyan
    Diao, Zhaoshuo
    Tong, Guoyu
    Luan, Qiu
    Li, Yaming
    Li, Xuena
    COMPUTERS IN BIOLOGY AND MEDICINE, 2023, 153
  • [9] A neural network-based method using uEXPLORER total-body PET to optimize the input function for the whole-body PET quantification on conventional PET-CT scanner
    Gu, Wenjian
    Wang, Yihan
    Zheng, Chaojie
    Kang, Fei
    Liu, Jianjun
    Fan, Wei
    Zhou, Yun
    JOURNAL OF NUCLEAR MEDICINE, 2023, 64
  • [10] DGCBG-Net: A dual-branch network with global cross-modal interaction and boundary guidance for tumor segmentation in PET/CT images
    Zou, Ziwei
    Zou, Beiji
    Kui, Xiaoyan
    Chen, Zhi
    Li, Yang
    COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE, 2024, 250