MSM-TDE: multi-scale semantics mining and tiny details enhancement network for retinal vessel segmentation

被引:0
作者
Zhang, Hongbin [1 ]
Zhang, Jin [1 ]
Zhong, Xuan [2 ]
Feng, Ya [1 ]
Li, Guangli [1 ]
Li, Xiong [1 ]
Lv, Jingqin [1 ]
Ji, Donghong [3 ]
机构
[1] East China Jiaotong Univ, Sch Informat & Software Engn, Nanchang, Peoples R China
[2] Jiangxi Univ Finance & Econ, Modern Ind Sch Virtual Real, Nanchang, Peoples R China
[3] Wuhan Univ, Cyber Sci & Engn Sch, Wuhan, Peoples R China
基金
中国国家自然科学基金;
关键词
Retinal vessel segmentation; Multi-scale semantics mining; Tiny details enhancement; U-Net; BLOOD-VESSELS; NET; IMAGES; PLUS;
D O I
10.1007/s40747-024-01714-7
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Retinal image segmentation is crucial for the early diagnosis of some diseases like diabetes and hypertension. Current methods face many challenges, such as inadequate multi-scale semantics and insufficient global information. In view of this, we propose a network called multi-scale semantics mining and tiny details enhancement (MSM-TDE). First, a multi-scale feature input module is designed to capture multi-scale semantics information from the source. Then a fresh multi-scale attention guidance module is constructed to mine local multi-scale semantics while a global semantics enhancement module is proposed to extract global multi-scale semantics. Additionally, an auxiliary vessel detail enhancement branch using dynamic snake convolution is built to enhance the tiny vessel details. Extensive experimental results on four public datasets validate the superiority of MSM-TDE, which obtains competitive performance with satisfactory model complexity. Notably, this study provides an innovative idea of multi-scale semantics mining by diverse methods.
引用
收藏
页数:23
相关论文
共 81 条
  • [71] MetaFormer is Actually What You Need for Vision
    Yu, Weihao
    Luo, Mi
    Zhou, Pan
    Si, Chenyang
    Zhou, Yichen
    Wang, Xinchao
    Feng, Jiashi
    Yan, Shuicheng
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 10809 - 10819
  • [72] Multi-Level Attention Network for Retinal Vessel Segmentation
    Yuan, Yuchen
    Zhang, Lei
    Wang, Lituan
    Huang, Haiying
    [J]. IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2022, 26 (01) : 312 - 323
  • [73] BCU-Net: Bridging ConvNeXt and U-Net for medical image segmentation
    Zhang, Hongbin
    Zhong, Xiang
    Li, Guangli
    Liu, Wei
    Liu, Jiawei
    Ji, Donghong
    Li, Xiong
    Wu, Jianguo
    [J]. COMPUTERS IN BIOLOGY AND MEDICINE, 2023, 159
  • [74] Robust Retinal Vessel Segmentation via Locally Adaptive Derivative Frames in Orientation Scores
    Zhang, Jiong
    Dashtbozorg, Behdad
    Bekkers, Erik
    Pluim, Josien P. W.
    Duits, Remco
    Romeny, Bart M. ter Haar
    [J]. IEEE TRANSACTIONS ON MEDICAL IMAGING, 2016, 35 (12) : 2631 - 2644
  • [75] Attention Guided Network for Retinal Image Segmentation
    Zhang, Shihao
    Fu, Huazhu
    Yan, Yuguang
    Zhang, Yubing
    Wu, Qingyao
    Yang, Ming
    Tan, Mingkui
    Xu, Yanwu
    [J]. MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2019, PT I, 2019, 11764 : 797 - 805
  • [76] Edge-aware U-net with gated convolution for retinal vessel segmentation
    Zhang, Yu
    Fang, Jing
    Chen, Ying
    Jia, Lu
    [J]. BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2022, 73
  • [77] Bridge-Net: Context-involved U-net with patch-based loss weight mapping for retinal blood vessel segmentation
    Zhang, Yuan
    He, Miao
    Chen, Zhineng
    Hu, Kai
    Li, Xuanya
    Gao, Xieping
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2022, 195
  • [78] Do you need sharpened details? Asking MMDC-Net: Multi-layer multi-scale dilated convolution network for retinal vessel segmentation
    Zhong, Xiang
    Zhang, Hongbin
    Li, Guangli
    Ji, Donghong
    [J]. COMPUTERS IN BIOLOGY AND MEDICINE, 2022, 150
  • [79] Dual-path multi-scale context dense aggregation network for retinal vessel segmentation
    Zhou, Wei
    Bai, Weiqi
    Ji, Jianhang
    Yi, Yugen
    Zhang, Ningyi
    Cui, Wei
    [J]. COMPUTERS IN BIOLOGY AND MEDICINE, 2023, 164
  • [80] UNet plus plus : A Nested U-Net Architecture for Medical Image Segmentation
    Zhou, Zongwei
    Siddiquee, Md Mahfuzur Rahman
    Tajbakhsh, Nima
    Liang, Jianming
    [J]. DEEP LEARNING IN MEDICAL IMAGE ANALYSIS AND MULTIMODAL LEARNING FOR CLINICAL DECISION SUPPORT, DLMIA 2018, 2018, 11045 : 3 - 11