ODFormer: Semantic fundus image segmentation using Transformer for optic nerve head detection

被引:0
作者
Wang, Jiayi [1 ,2 ,3 ,4 ]
Mao, Yi-An [5 ]
Ma, Xiaoyu [6 ]
Guo, Sicen [1 ,2 ,3 ,4 ]
Shao, Yuting [6 ]
Lv, Xiao [6 ]
Han, Wenting [6 ]
Christopher, Mark [7 ,8 ]
Zangwill, Linda M. [7 ,8 ]
Bi, Yanlong [6 ,9 ]
Fan, Rui [1 ,2 ,3 ,4 ]
机构
[1] Tongji Univ, Coll Elect & Informat Engn, Dept Control Sci & Engn, MIAS Grp, Shanghai 201804, Peoples R China
[2] Tongji Univ, Shanghai Inst Intelligent Sci & Technol, Shanghai 201804, Peoples R China
[3] Tongji Univ, Shanghai Res Inst Intelligent Autonomous Syst, State Key Lab Intelligent Autonomous Syst, Shanghai 201210, Peoples R China
[4] Tongji Univ, Frontiers Sci Ctr Intelligent Autonomous Syst, Shanghai 201210, Peoples R China
[5] Shanghai Univ, Sch Life Sci, 99 Shangda Ave, Shanghai 200444, Peoples R China
[6] Tongji Univ, Tongji Hosp, Sch Med, Dept Ophthalmol, Shanghai 200065, Peoples R China
[7] Univ Calif San Diego, Hamilton Glaucoma Ctr, La Jolla, CA 92037 USA
[8] Univ Calif San Diego, Shiley Eye Inst, Viterbi Family Dept Ophthalmol, Div Ophthalmol Informat & Data Sci, La Jolla, CA 92037 USA
[9] Tongji Univ, Tongji Eye Inst, Sch Med, Shanghai 200065, Peoples R China
基金
中国国家自然科学基金;
关键词
Optic nerve head; Fundus image; Semantic segmentation; Convolutional neural network; Transformer; FOVEA;
D O I
10.1016/j.inffus.2024.102533
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Optic nerve head (ONH) detection has been a crucial area of study in ophthalmology for years. However, the significant discrepancy between fundus image datasets, each generated using a single type of fundus camera, poses challenges to the generalizability of ONH detection approaches developed based on semantic segmentation networks. Despite the numerous recent advancements in general-purpose semantic segmentation methods using convolutional neural networks (CNNs) and Transformers, there is currently a lack of benchmarks for these state -of -the -art (SoTA) networks specifically trained for ONH detection. Therefore, in this article, we make contributions from three key aspects: network design, the publication of a dataset, and the establishment of a comprehensive benchmark. Our newly developed ONH detection network, referred to as ODFormer, is based upon the Swin Transformer architecture and incorporates two novel components: a multi-scale context aggregator and a lightweight bidirectional feature recalibrator. Our published large-scale dataset, known as TongjiU-DROD, provides multi -resolution fundus images for each participant, captured using two distinct types of cameras. Our established benchmark involves three datasets: DRIONS-DB, DRISHTI-GS1, and TongjiU-DROD, created by researchers from different countries and containing fundus images captured from participants of diverse races and ages. Extensive experimental results demonstrate that our proposed ODFormer outperforms other state -of -the -art (SoTA) networks in terms of performance and generalizability. Our dataset and source code are publicly available at https://mias.group/ODFormer.
引用
收藏
页数:10
相关论文
共 50 条
  • [31] Automatic glaucoma screening using optic nerve head measurements and random forest classifier on fundus images
    Mohamed Bouacheria
    Yazid Cherfa
    Assia Cherfa
    Noureddine Belkhamsa
    Physical and Engineering Sciences in Medicine, 2020, 43 : 1265 - 1277
  • [32] Automatic glaucoma screening using optic nerve head measurements and random forest classifier on fundus images
    Bouacheria, Mohamed
    Cherfa, Yazid
    Cherfa, Assia
    Belkhamsa, Noureddine
    PHYSICAL AND ENGINEERING SCIENCES IN MEDICINE, 2020, 43 (04) : 1265 - 1277
  • [33] Segmentation of Optic Disc in Fundus Images Using an Active Contour
    Elbalaoui, A.
    Ouadid, Y.
    Merbouha, A.
    JOURNAL OF ELECTRONIC COMMERCE IN ORGANIZATIONS, 2018, 16 (01) : 97 - 111
  • [34] Blood Vessel Detection from Fundus Image Using Markov Random Field Based Image Segmentation
    Hossain, Nafize Ishtiaque
    Reza, Sakib
    2017 4TH INTERNATIONAL CONFERENCE ON ADVANCES IN ELECTRICAL ENGINEERING (ICAEE), 2017, : 123 - 127
  • [35] Optic Disk Detection in Fundus Image Based on Structured Learning
    Fan, Zhun
    Rong, Yibiao
    Cai, Xinye
    Lu, Jiewei
    Li, Wenji
    Lin, Huibiao
    Chen, Xinjian
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2018, 22 (01) : 224 - 234
  • [36] Two-Stage Mask-RCNN Approach for Detecting and Segmenting the Optic Nerve Head, Optic Disc, and Optic Cup in Fundus Images
    Almubarak, Haidar
    Bazi, Yakoub
    Alajlan, Naif
    APPLIED SCIENCES-BASEL, 2020, 10 (11):
  • [37] Computational Efficiency of Optic Disk Detection on Fundus Image: A survey
    Ben Sayadia, Sofien
    YaroubElloumi
    Akil, Mohamed
    HediBedoui, Mohamed
    REAL-TIME IMAGE AND VIDEO PROCESSING 2018, 2018, 10670
  • [38] BOUNDARY SEGMENTATION AND DETECTION OF DIABETIC RETINOPATHY (DR) IN FUNDUS IMAGE
    Samad, R.
    Nasarudin, M. S. F.
    Mustafa, M.
    Pebrianti, D.
    Abdullah, N. R. H.
    JURNAL TEKNOLOGI, 2015, 77 (06): : 25 - 28
  • [39] Combining Swin Transformer With UNet for Remote Sensing Image Semantic Segmentation
    Fan, Lili
    Zhou, Yu
    Liu, Hongmei
    Li, Yunjie
    Cao, Dongpu
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61 : 1 - 11
  • [40] Swin Transformer Embedding UNet for Remote Sensing Image Semantic Segmentation
    He, Xin
    Zhou, Yong
    Zhao, Jiaqi
    Zhang, Di
    Yao, Rui
    Xue, Yong
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60