RVD: A Handheld Device-Based Fundus Video Dataset for Retinal Vessel Segmentation

被引:0
作者
Khan, Md Wahiduzzaman [1 ]
Sheng, Hongwei [1 ,2 ]
Zhang, Hu [2 ]
Du, Heming [3 ]
Wang, Sen [2 ]
Coroneo, Minas Theodore [4 ]
Hajati, Farshid [5 ]
Shariflou, Sahar [1 ]
Kalloniatis, Michael [6 ]
Phu, Jack [4 ]
Agar, Ashish [4 ]
Huang, Zi [2 ]
Golzan, Mojtaba [1 ]
Yu, Xin [2 ]
机构
[1] Univ Technol Sydney, Sydney, NSW, Australia
[2] Univ Queensland, Brisbane, Qld, Australia
[3] Australian Natl Univ, Canberra, ACT, Australia
[4] Univ New South Wales, Sydney, NSW, Australia
[5] Univ Victoria, Victoria, BC, Canada
[6] Univ Houston Downtown, Houston, TX USA
来源
ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023) | 2023年
关键词
CONVOLUTIONAL NEURAL-NETWORK; BLOOD-VESSELS; CLASSIFICATION; ARCHITECTURE; IMAGES; NET;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Retinal vessel segmentation is generally grounded in image-based datasets collected with bench-top devices. The static images naturally lose the dynamic characteristics of retina fluctuation, resulting in diminished dataset richness, and the usage of bench-top devices further restricts dataset scalability due to its limited accessibility. Considering these limitations, we introduce the first video-based retinal dataset by employing handheld devices for data acquisition. The dataset comprises 635 smartphone-based fundus videos collected from four different clinics, involving 415 patients from 50 to 75 years old. It delivers comprehensive and precise annotations of retinal structures in both spatial and temporal dimensions, aiming to advance the landscape of vasculature segmentation. Specifically, the dataset provides three levels of spatial annotations: binary vessel masks for overall retinal structure delineation, general vein-artery masks for distinguishing the vein and artery, and fine-grained vein-artery masks for further characterizing the granularities of each artery and vein. In addition, the dataset offers temporal annotations that capture the vessel pulsation characteristics, assisting in detecting ocular diseases that require fine-grained recognition of hemodynamic fluctuation. In application, our dataset exhibits a significant domain shift with respect to data captured by bench-top devices, thus posing great challenges to existing methods. Thanks to rich annotations and data scales, our dataset potentially paves the path for more advanced retinal analysis and accurate disease diagnosis. In the experiments, we provide evaluation metrics and benchmark results on our dataset, reflecting both the potential and challenges it offers for vessel segmentation tasks. We hope this challenging dataset would significantly contribute to the development of eye disease diagnosis and early prevention. The dataset is available at (sic) RVD.
引用
收藏
页数:22
相关论文
共 96 条
[51]   Swin Transformer: Hierarchical Vision Transformer using Shifted Windows [J].
Liu, Ze ;
Lin, Yutong ;
Cao, Yue ;
Hu, Han ;
Wei, Yixuan ;
Zhang, Zheng ;
Lin, Stephen ;
Guo, Baining .
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, :9992-10002
[52]  
Long J, 2015, PROC CVPR IEEE, P3431, DOI 10.1109/CVPR.2015.7298965
[53]   ROSE: A Retinal OCT-Angiography Vessel Segmentation Dataset and New Model [J].
Ma, Yuhui ;
Hao, Huaying ;
Xie, Jianyang ;
Fu, Huazhu ;
Zhang, Jiong ;
Yang, Jianlong ;
Wang, Zhen ;
Liu, Jiang ;
Zheng, Yalin ;
Zhao, Yitian .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2021, 40 (03) :928-939
[54]  
Maji Debapriya, 2016, arXiv
[55]   Automatic localization of the optic disc by combining vascular and intensity information [J].
Mendonca, Ana Maria ;
Sousa, Antonio ;
Mendonca, Luis ;
Campilho, Aurelio .
COMPUTERIZED MEDICAL IMAGING AND GRAPHICS, 2013, 37 (5-6) :409-417
[56]  
MMSegmentation Contributors, 2020, MMSEGMENTATION OP SE
[57]  
Mo Zhang, 2020, Medical Image Computing and Computer Assisted Intervention - MICCAI 2020. 23rd International Conference. Proceedings. Lecture Notes in Computer Science (LNCS 12265), P775, DOI 10.1007/978-3-030-59722-1_75
[58]   A review of machine learning methods for retinal blood vessel segmentation and artery/vein classification [J].
Mookiah, Muthu Rama Krishnan ;
Hogg, Stephen ;
MacGillivray, Tom J. ;
Prathiba, Vijayaraghavan ;
Pradeepa, Rajendra ;
Mohan, Viswanathan ;
Anjana, Ranjit Mohan ;
Doney, Alexander S. ;
Palmer, Colin N. A. ;
Trucco, Emanuele .
MEDICAL IMAGE ANALYSIS, 2021, 68
[59]   An Update on Imaging in Idiopathic Intracranial Hypertension [J].
Moreno-Ajona, David ;
McHugh, James Alexander ;
Hoffmann, Jan .
FRONTIERS IN NEUROLOGY, 2020, 11
[60]   Retinal venous pulsation: Expanding our understanding and use of this enigmatic phenomenon [J].
Morgan, William H. ;
Hazelton, Martin L. ;
Yu, Dao-Yi .
PROGRESS IN RETINAL AND EYE RESEARCH, 2016, 55 :82-107