Selective and multi-scale fusion Mamba for medical image segmentation

被引:1
|
作者
Li, Guangju [1 ,2 ]
Huang, Qinghua [2 ]
Wang, Wei [3 ]
Liu, Longzhong [4 ]
机构
[1] Northwestern Polytech Univ, Sch Comp Sci, Xian 710129, Peoples R China
[2] Northwestern Polytech Univ, Sch Artificial Intelligence Opt & Elect iOPEN, Xian 710072, Peoples R China
[3] Sun Yat Sen Univ, Ultras Artificial Intelligence X Lab, Inst Diagnost & Intervent Ultrasound, Dept Med Ultrason,Affiliated Hosp 1, Guangzhou 510060, Peoples R China
[4] Sun Yat Sen Univ, Guangdong Prov Clin Res Ctr Canc, Dept Ultrasound, State Key Lab Oncol South China,Canc Ctr, Guangzhou 510060, Peoples R China
基金
中国国家自然科学基金;
关键词
Medical image segmentation; Mamba; U-shape network; Multi-scale fusion; TRANSFORMER;
D O I
10.1016/j.eswa.2024.125518
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Given the high variability in the morphology and size of lesion areas in medical images, accurate medical image segmentation requires both precise positioning of global contours and careful processing of local boundaries. This emphasizes the importance of fusing multi-scale local and global features. However, existing CNN and Transformer-based models are often limited by high parameter counts and complex calculations, making it difficult to efficiently integrate these features. To address this challenge, we proposed two innovative optimization architectures: Selective Fusion Mamba (SF-Mamba) and Multi-Scale Fusion Mamba (MF-Mamba). SF-Mamba can flexibly and dynamically adjust the fusion strategy of local and global features according to the characteristics of the lesions, effectively handling segmentation tasks with variable morphology. MFMamba enhances the model's segmentation ability for lesions of different sizes by capturing global information across scales. Based on these two structures, we constructed a lightweight SMM-UNet model, which not only significantly reduces the computational burden (with only 0.038M parameters) but also demonstrates excellent generalization ability and can efficiently adapt to various types of medical images. Extensive tests on the ISIC2017, ISIC2018, and BUSI public datasets show that SMM-UNet achieves excellent segmentation performance with an extremely low parameter cost.
引用
收藏
页数:8
相关论文
共 50 条
  • [1] Multi-scale feature pyramid fusion network for medical image segmentation
    Zhang, Bing
    Wang, Yang
    Ding, Caifu
    Deng, Ziqing
    Li, Linwei
    Qin, Zesheng
    Ding, Zhao
    Bian, Lifeng
    Yang, Chen
    INTERNATIONAL JOURNAL OF COMPUTER ASSISTED RADIOLOGY AND SURGERY, 2023, 18 (02) : 353 - 365
  • [2] MFLUnet: multi-scale fusion lightweight Unet for medical image segmentation
    Cao, Dianlei
    Zhang, Rui
    Zhang, Yunfeng
    BIOMEDICAL OPTICS EXPRESS, 2024, 15 (10): : 5574 - 5591
  • [3] Multi-scale feature pyramid fusion network for medical image segmentation
    Bing Zhang
    Yang Wang
    Caifu Ding
    Ziqing Deng
    Linwei Li
    Zesheng Qin
    Zhao Ding
    Lifeng Bian
    Chen Yang
    International Journal of Computer Assisted Radiology and Surgery, 2023, 18 : 353 - 365
  • [4] Medical image segmentation with UNet-based multi-scale context fusion
    Yuan, Yongqi
    Cheng, Yong
    SCIENTIFIC REPORTS, 2024, 14 (01):
  • [5] Sub-pixel multi-scale fusion network for medical image segmentation
    Jing Li
    Qiaohong Chen
    Xian Fang
    Multimedia Tools and Applications, 2024, 83 (41) : 89355 - 89373
  • [6] ECM-TransUNet: Edge-enhanced multi-scale attention and convolutional Mamba for medical image segmentation
    Lv, Chunjie
    Li, Biyuan
    Wang, Xiuwei
    Cai, Pengfei
    Yang, Bo
    Sun, Gaowei
    Yan, Jun
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2025, 107
  • [7] Collaborative Attention Guided Multi-Scale Feature Fusion Network for Medical Image Segmentation
    Xu, Zhenghua
    Tian, Biao
    Liu, Shijie
    Wang, Xiangtao
    Yuan, Di
    Gu, Junhua
    Chen, Junyang
    Lukasiewicz, Thomas
    Leung, Victor C. M.
    IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2024, 11 (02): : 1857 - 1871
  • [8] Dynamic hierarchical multi-scale fusion network with axial MLP for medical image segmentation
    Cheng, Zhikun
    Wang, Liejun
    SCIENTIFIC REPORTS, 2023, 13 (01)
  • [9] Lightweight medical image segmentation network with multi-scale feature-guided fusion
    Zhu, Zhiqin
    Yu, Kun
    Qi, Guanqiu
    Cong, Baisen
    Li, Yuanyuan
    Li, Zexin
    Gao, Xinbo
    Computers in Biology and Medicine, 2024, 182
  • [10] MTC-Net: Multi-scale feature fusion network for medical image segmentation
    Ren S.
    Wang Y.
    Journal of Intelligent and Fuzzy Systems, 2024, 46 (04): : 8729 - 8740