VerFormer: Vertebrae-Aware Transformer for Automatic Spine Segmentation from CT Images

被引:0
|
作者
Li, Xinchen [1 ]
Hong, Yuan [1 ]
Xu, Yang [1 ]
Hu, Mu [1 ]
机构
[1] Shanghai Jiao Tong Univ, Sch Med, Ruijin Hosp, Dept Orthoped, Shanghai 200025, Peoples R China
关键词
Vision Transformer; spine CT segmentation; attention mechanism; FRAMEWORK; NETWORKS;
D O I
10.3390/diagnostics14171859
中图分类号
R5 [内科学];
学科分类号
1002 ; 100201 ;
摘要
The accurate and efficient segmentation of the spine is important in the diagnosis and treatment of spine malfunctions and fractures. However, it is still challenging because of large inter-vertebra variations in shape and cross-image localization of the spine. In previous methods, convolutional neural networks (CNNs) have been widely applied as a vision backbone to tackle this task. However, these methods are challenged in utilizing the global contextual information across the whole image for accurate spine segmentation because of the inherent locality of the convolution operation. Compared with CNNs, the Vision Transformer (ViT) has been proposed as another vision backbone with a high capacity to capture global contextual information. However, when the ViT is employed for spine segmentation, it treats all input tokens equally, including vertebrae-related tokens and non-vertebrae-related tokens. Additionally, it lacks the capability to locate regions of interest, thus lowering the accuracy of spine segmentation. To address this limitation, we propose a novel Vertebrae-aware Vision Transformer (VerFormer) for automatic spine segmentation from CT images. Our VerFormer is designed by incorporating a novel Vertebrae-aware Global (VG) block into the ViT backbone. In the VG block, the vertebrae-related global contextual information is extracted by a Vertebrae-aware Global Query (VGQ) module. Then, this information is incorporated into query tokens to highlight vertebrae-related tokens in the multi-head self-attention module. Thus, this VG block can leverage global contextual information to effectively and efficiently locate spines across the whole input, thus improving the segmentation accuracy of VerFormer. Driven by this design, the VerFormer demonstrates a solid capacity to capture more discriminative dependencies and vertebrae-related context in automatic spine segmentation. The experimental results on two spine CT segmentation tasks demonstrate the effectiveness of our VG block and the superiority of our VerFormer in spine segmentation. Compared with other popular CNN- or ViT-based segmentation models, our VerFormer shows superior segmentation accuracy and generalization.
引用
收藏
页数:14
相关论文
共 50 条
  • [21] Automatic segmentation of neck CT images
    Teng, Chia-Chi
    Shapiro, Linda G.
    Kalet, Ira
    19TH IEEE INTERNATIONAL SYMPOSIUM ON COMPUTER-BASED MEDICAL SYSTEMS, PROCEEDINGS, 2006, : 442 - +
  • [23] Automatic segmentation of bladder in CT images
    Feng Shi
    Jie Yang
    Yue-min Zhu
    Journal of Zhejiang University-SCIENCE A, 2009, 10 : 239 - 246
  • [24] FULLY AUTOMATIC SEGMENTATION OF LUMBAR VERTEBRAE FROM CT IMAGES USING CASCADED 3D FULLY CONVOLUTIONAL NETWORKS
    Janssens, Rens
    Zeng, Guodong
    Zheng, Guoyan
    2018 IEEE 15TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (ISBI 2018), 2018, : 893 - 897
  • [25] LDANet: Automatic lung parenchyma segmentation from CT images
    Chen, Ying
    Feng, Longfeng
    Zheng, Cheng
    Zhou, Taohui
    Liu, Lan
    Liu, Pengfei
    Chen, Yi
    COMPUTERS IN BIOLOGY AND MEDICINE, 2023, 155
  • [26] Automatic Couinaud liver and veins segmentation from CT images
    Oliveira, Dario A. B.
    Feitosa, Raul Q.
    Correia, Mauro A.
    BIOSIGNALS 2008: PROCEEDINGS OF THE FIRST INTERNATIONAL CONFERENCE ON BIO-INSPIRED SYSTEMS AND SIGNAL PROCESSING, VOL 1, 2008, : 249 - +
  • [27] Automatic Liver Parenchyma Segmentation from Abdominal CT Images
    Anter, Ahmed M.
    Abu ElSoud, Mohamed
    Hassanien, Aboul Ella
    2013 9TH INTERNATIONAL COMPUTER ENGINEERING CONFERENCE (ICENCO 2013): TODAY INFORMATION SOCIETY WHAT'S NEXT?, 2014, : 32 - 36
  • [28] Automatic Segmentation of Intracerebral Hemorrhage from Brain CT Images
    Gautam, Anjali
    Raman, Balasubramanian
    MACHINE INTELLIGENCE AND SIGNAL ANALYSIS, 2019, 748 : 753 - 764
  • [29] Automatic Lumbar Spine Measurement in CT Images
    Mao, Yunxiang
    Zheng, Dong
    Liao, Shu
    Peng, Zhigang
    Yan, Ruyi
    Liu, Junhua
    Dong, Zhingxing
    Gong, Liyan
    Zhou, Xiang Sean
    Zhan, Yiqiang
    Fei, Jun
    MEDICAL IMAGING 2017: COMPUTER-AIDED DIAGNOSIS, 2017, 10134
  • [30] An Effective CNN Approach for Vertebrae Segmentation from 3D CT Images
    Kuok, Chan-Pang
    Hsue, Jin-Yuan
    Shen, Ting-Li
    Huang, Bing-Feng
    Chen, Chi-Yeh
    Sun, Yung-Nien
    PROCEEDINGS OF THE 2018 PACIFIC NEIGHBORHOOD CONSORTIUM ANNUAL CONFERENCE AND JOINT MEETINGS (PNC) - HUMAN RIGHTS IN CYBERSPACE, 2018, : 7 - 12