Non-invasive and objective tear film breakup detection on interference color images using convolutional neural networks

PurposeDry eye disease affects hundreds of millions of people worldwide and is one of the most common causes for visits to eye care practitioners. The fluorescein tear breakup time test is currently widely used to diagnose dry eye disease, but it is an invasive and subjective method, thus resulting in variability in diagnostic results. This study aimed to develop an objective method to detect tear breakup using the convolutional neural networks on the tear film images taken by the non-invasive device KOWA DR-1 alpha. MethodsThe image classification models for detecting characteristics of tear film images were constructed using transfer learning of the pre-trained ResNet50 model. The models were trained using a total of 9,089 image patches extracted from video data of 350 eyes of 178 subjects taken by the KOWA DR-1 alpha. The trained models were evaluated based on the classification results for each class and overall accuracy of the test data in the six-fold cross validation. The performance of the tear breakup detection method using the models was evaluated by calculating the area under curve (AUC) of receiver operating characteristic, sensitivity, and specificity using the detection results of 13,471 frame images with breakup presence/absence labels. ResultsThe performance of the trained models was 92.3%, 83.4%, and 95.2% for accuracy, sensitivity, and specificity, respectively in classifying the test data into the tear breakup or non-breakup group. Our method using the trained models achieved an AUC of 0.898, a sensitivity of 84.3%, and a specificity of 83.3% in detecting tear breakup for a frame image. ConclusionsWe were able to develop a method to detect tear breakup on images taken by the KOWA DR-1 alpha. This method could be applied to the clinical use of non-invasive and objective tear breakup time test.