MSM-TDE: multi-scale semantics mining and tiny details enhancement network for retinal vessel segmentation

被引:0
作者
Zhang, Hongbin [1 ]
Zhang, Jin [1 ]
Zhong, Xuan [2 ]
Feng, Ya [1 ]
Li, Guangli [1 ]
Li, Xiong [1 ]
Lv, Jingqin [1 ]
Ji, Donghong [3 ]
机构
[1] East China Jiaotong Univ, Sch Informat & Software Engn, Nanchang, Peoples R China
[2] Jiangxi Univ Finance & Econ, Modern Ind Sch Virtual Real, Nanchang, Peoples R China
[3] Wuhan Univ, Cyber Sci & Engn Sch, Wuhan, Peoples R China
基金
中国国家自然科学基金;
关键词
Retinal vessel segmentation; Multi-scale semantics mining; Tiny details enhancement; U-Net; BLOOD-VESSELS; NET; IMAGES; PLUS;
D O I
10.1007/s40747-024-01714-7
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Retinal image segmentation is crucial for the early diagnosis of some diseases like diabetes and hypertension. Current methods face many challenges, such as inadequate multi-scale semantics and insufficient global information. In view of this, we propose a network called multi-scale semantics mining and tiny details enhancement (MSM-TDE). First, a multi-scale feature input module is designed to capture multi-scale semantics information from the source. Then a fresh multi-scale attention guidance module is constructed to mine local multi-scale semantics while a global semantics enhancement module is proposed to extract global multi-scale semantics. Additionally, an auxiliary vessel detail enhancement branch using dynamic snake convolution is built to enhance the tiny vessel details. Extensive experimental results on four public datasets validate the superiority of MSM-TDE, which obtains competitive performance with satisfactory model complexity. Notably, this study provides an innovative idea of multi-scale semantics mining by diverse methods.
引用
收藏
页数:23
相关论文
共 81 条
  • [41] Mathews Mili Rosline, 2020, 2020 3rd International Conference on Signal Processing and Information Security (ICSPIS), DOI 10.1109/ICSPIS51252.2020.9340135
  • [42] CS2-Net: Deep learning segmentation of curvilinear structures in medical imaging
    Mou, Lei
    Zhao, Yitian
    Fu, Huazhu
    Liu, Yonghuai
    Cheng, Jun
    Zheng, Yalin
    Su, Pan
    Yang, Jianlong
    Chen, Li
    Frangi, Alejandro F.
    Akiba, Masahiro
    Liu, Jiang
    [J]. MEDICAL IMAGE ANALYSIS, 2021, 67
  • [43] Oktay O, 2018, Arxiv, DOI arXiv:1804.03999
  • [44] LEA U-Net: a U-Net-based deep learning framework with local feature enhancement and attention for retinal vessel segmentation
    Ouyang, Jihong
    Liu, Siguang
    Peng, Hao
    Garg, Harish
    Thanh, Dang N. H.
    [J]. COMPLEX & INTELLIGENT SYSTEMS, 2023, 9 (06) : 6753 - 6766
  • [45] Measuring Retinal Vessel Tortuosity in 10-Year-Old Children: Validation of the Computer-Assisted Image Analysis of the Retina (CAIAR) Program
    Owen, Christopher G.
    Rudnicka, Alicja R.
    Mullen, Robert
    Barman, Sarah A.
    Monekosso, Dorothy
    Whincup, Peter H.
    Ng, Jeffrey
    Paterson, Carl
    [J]. INVESTIGATIVE OPHTHALMOLOGY & VISUAL SCIENCE, 2009, 50 (05) : 2004 - 2010
  • [46] Directional mutation and crossover boosted ant colony optimization with application to COVID-19 X-ray image segmentation
    Qi, Ailiang
    Zhao, Dong
    Yu, Fanhua
    Heidari, Ali Asghar
    Wu, Zongda
    Cai, Zhennao
    Alenezi, Fayadh
    Mansour, Romany F.
    Chen, Huiling
    Chen, Mayun
    [J]. COMPUTERS IN BIOLOGY AND MEDICINE, 2022, 148
  • [47] Dynamic Snake Convolution based on Topological Geometric Constraints for Tubular Structure Segmentation
    Qi, Yaolei
    He, Yuting
    Qi, Xiaoming
    Zhang, Yuan
    Yang, Guanyu
    [J]. 2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION, ICCV, 2023, : 6047 - 6056
  • [48] Detection of Diabetic Retinopathy and Maculopathy in Eye Fundus Images Using Deep Learning and Image Augmentation
    Rahim, Sarni Suhaila
    Palade, Vasile
    Almakky, Ibrahim
    Holzinger, Andreas
    [J]. MACHINE LEARNING AND KNOWLEDGE EXTRACTION, CD-MAKE 2019, 2019, 11713 : 114 - 127
  • [49] U-Net: Convolutional Networks for Biomedical Image Segmentation
    Ronneberger, Olaf
    Fischer, Philipp
    Brox, Thomas
    [J]. MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION, PT III, 2015, 9351 : 234 - 241
  • [50] Gaussian Context Transformer
    Ruan, Dongsheng
    Wang, Daiyin
    Zheng, Yuan
    Zheng, Nenggan
    Zheng, Min
    [J]. 2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 15124 - 15133