Mapping the Ocular Surface from Monocular Videos with an Application to Dry Eye Disease Grading

被引:0
作者
Brahim, Ikram [1 ,2 ,3 ]
Lamard, Mathieu [1 ,3 ]
Benyoussef, Anas-Alexis [1 ,3 ,4 ]
Conze, Pierre-Henri [1 ,5 ]
Cochener, Beatrice [1 ,3 ,4 ]
Cornec, Divi [2 ,3 ]
Quellec, Gwenole [1 ]
机构
[1] INSERM, LaTIM UMR 1101, Brest, France
[2] INSERM, LBAI UMR 1227, Brest, France
[3] Univ Western Brittany, Brest, France
[4] CHRU Brest, Ophtalmol Dept, Brest, France
[5] IMT Atlantique, Brest, France
来源
OPHTHALMIC MEDICAL IMAGE ANALYSIS, OMIA 2022 | 2022年 / 13576卷
关键词
Dry Eye Disease; Self-supervised learning; Sphere fitting loss;
D O I
10.1007/978-3-031-16525-2_7
中图分类号
R77 [眼科学];
学科分类号
100212 ;
摘要
With a prevalence of 5 to 50%, Dry Eye Disease (DED) is one of the leading reasons for ophthalmologist consultations. The diagnosis and quantification of DED usually rely on ocular surface analysis through slit-lamp examinations. However, evaluations are subjective and non-reproducible. To improve the diagnosis, we propose to 1) track the ocular surface in 3-D using video recordings acquired during examinations, and 2) grade the severity using registered frames. Our registration method uses unsupervised image-to-depth learning. These methods learn depth from lights and shadows and estimate pose based on depth maps. However, DED examinations undergo unresolved challenges including a moving light source, transparent ocular tissues, etc. To overcome these and estimate the ego-motion, we implement joint CNN architectures with multiple losses incorporating prior known information, namely the shape of the eye, through semantic segmentation as well as sphere fitting. The achieved tracking errors outperform the state-of-the-art, with a mean Euclidean distance as low as 0.48% of the image width on our test set. This registration improves the DED severity classification by a 0.20 AUC difference. The proposed approach is the first to address DED diagnosis with supervision from monocular videos.
引用
收藏
页码:63 / 72
页数:10
相关论文
共 23 条
[1]   Review of visual odometry: types, approaches, challenges, and applications [J].
Aqel, Mohammad O. A. ;
Marhaban, Mohammad H. ;
Saripan, M. Iqbal ;
Ismail, Napsiah Bt. .
SPRINGERPLUS, 2016, 5
[2]   Review and analysis of grading scales for ocular surface staining [J].
Begley, Carolyn ;
Caffery, Barbara ;
Chalmers, Robin ;
Situ, Ping ;
Simpson, Trefford ;
Nelson, J. Daniel .
OCULAR SURFACE, 2019, 17 (02) :208-220
[3]   The Doyne Lecture - Reflections on the tears [J].
Bron, AJ .
EYE, 1997, 11 (5) :583-602
[4]   Unsupervised monocular depth and ego-motion learning with structure and semantics [J].
Casser, Vincent ;
Pirk, Soeren ;
Mahjourian, Reza ;
Angelova, Anelia .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2019), 2019, :381-388
[5]  
Casser V, 2019, AAAI CONF ARTIF INTE, P8001
[6]   The Cityscapes Dataset for Semantic Urban Scene Understanding [J].
Cordts, Marius ;
Omran, Mohamed ;
Ramos, Sebastian ;
Rehfeld, Timo ;
Enzweiler, Markus ;
Benenson, Rodrigo ;
Franke, Uwe ;
Roth, Stefan ;
Schiele, Bernt .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :3213-3223
[7]   Unsupervised Monocular Depth Estimation with Left-Right Consistency [J].
Godard, Clement ;
Mac Aodha, Oisin ;
Brostow, Gabriel J. .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :6602-6611
[8]   Depth from Videos in the Wild: Unsupervised Monocular Depth Learning from Unknown Cameras [J].
Gordon, Ariel ;
Li, Hanhan ;
Jonschkowski, Rico ;
Angelova, Anelia .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :8976-8985
[9]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[10]  
Jekel C.F, 2016, Digital Image Correlation on Steel Ball