MSDE-Net: A Multi-Scale Dual-Encoding Network for Surgical Instrument Segmentation

被引:2
作者
Yang, Lei [1 ]
Gu, Yuge [1 ]
Bian, Guibin [1 ,2 ]
Liu, Yanhong [1 ]
机构
[1] Zhengzhou Univ, Sch Elect & Informat Engn, Zhengzhou 450001, Peoples R China
[2] Chinese Acad Sci, Inst Automat, State Key Lab Management & Control Complex Syst, Beijing 100190, Peoples R China
基金
中国国家自然科学基金;
关键词
Surgical instrument segmentation; transformer; dual-branch encoder; feature fusion; IMAGE SEGMENTATION; SURGERY; COLOR; ROBOT;
D O I
10.1109/JBHI.2023.3344716
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Minimally invasive surgery, which relies on surgical robots and microscopes, demands precise image segmentation to ensure safe and efficient procedures. Nevertheless, achieving accurate segmentation of surgical instruments remains challenging due to the complexity of the surgical environment. To tackle this issue, this paper introduces a novel multiscale dual-encoding segmentation network, termed MSDE-Net, designed to automatically and precisely segment surgical instruments. The proposed MSDE-Net leverages a dual-branch encoder comprising a convolutional neural network (CNN) branch and a transformer branch to effectively extract both local and global features. Moreover, an attention fusion block (AFB) is introduced to ensure effective information complementarity between the dual-branch encoding paths. Additionally, a multilayer context fusion block (MCF) is proposed to enhance the network's capacity to simultaneously extract global and local features. Finally, to extend the scope of global feature information under larger receptive fields, a multi-receptive field fusion (MRF) block is incorporated. Through comprehensive experimental evaluations on two publicly available datasets for surgical instrument segmentation, the proposed MSDE-Net demonstrates superior performance compared to existing methods.
引用
收藏
页码:4072 / 4083
页数:12
相关论文
共 62 条
  • [61] Active contour model based on local and global Gaussian fitting energy for medical image segmentation
    Zhao, Wencheng
    Xu, Xianze
    Zhu, Yanyan
    Xu, Fengqiu
    [J]. OPTIK, 2018, 158 : 1160 - 1169
  • [62] UNet plus plus : Redesigning Skip Connections to Exploit Multiscale Features in Image Segmentation
    Zhou, Zongwei
    Siddiquee, Md Mahfuzur Rahman
    Tajbakhsh, Nima
    Liang, Jianming
    [J]. IEEE TRANSACTIONS ON MEDICAL IMAGING, 2020, 39 (06) : 1856 - 1867