500,000 Images Closer to Eyelid and Pupil Segmentation

被引:15
作者
Fuhl, Wolfgang [1 ]
Rosenstiel, Wolfgang [1 ]
Kasneci, Enkelejda [1 ]
机构
[1] Eberhard Karls Univ Tubingen, D-72076 Tubingen, Germany
来源
COMPUTER ANALYSIS OF IMAGES AND PATTERNS, CAIP 2019, PT I | 2019年 / 11678卷
关键词
Eye tracking; Eyelid segmentation; Eyelid opening; Pupil segmentation; Landmark detection; Landmark regression; Pupil ellipses regression; Eyelid regression; IRIS RECOGNITION; TRACKING; WILD;
D O I
10.1007/978-3-030-29888-3_27
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Human gaze behavior is not the only important aspect about eye tracking. The eyelids reveal additional important information; such as fatigue as well as the pupil size holds indications of the workload. The current state-of-the-art datasets focus on challenges in pupil center detection, whereas other aspects, such as the lid closure and pupil size, are neglected. Therefore, we propose a fully convolutional neural network for pupil and eyelid segmentation as well as eyelid landmark and pupil ellipsis regression. The network is jointly trained using the Log loss for segmentation and L1 loss for landmark and ellipsis regression. The application of the proposed network is the offline processing and creation of datasets. Which can be used to train resource-saving and real-time machine learning algorithms such as random forests. In addition, we will provide the worlds largest eye images dataset with more than 500,000 images DOWNLOAD.
引用
收藏
页码:336 / 347
页数:12
相关论文
共 64 条
[1]  
Adam M, 2008, RADIOENGINEERING, V17, P82
[2]   Online Eye Status Detection in the Wild with Convolutional Neural Networks [J].
Anas, Essa R. ;
Henriquez, Pedro ;
Matuszewski, Bogdan J. .
PROCEEDINGS OF THE 12TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS (VISIGRAPP 2017), VOL 6, 2017, :88-95
[3]  
[Anonymous], 2015, ARXIV151100561
[5]   The application of eye-tracking technology in the study of autism [J].
Boraston, Zillah ;
Blakemore, Sarah-Jayne .
JOURNAL OF PHYSIOLOGY-LONDON, 2007, 581 (03) :893-898
[6]   Ready for Take-Over? A New Driver Assistance System for an Automated Classification of Driver Take-Over Readiness [J].
Braunagel, Christian ;
Rosenstiel, Wolfgang ;
Kasneci, Enkelejda .
IEEE INTELLIGENT TRANSPORTATION SYSTEMS MAGAZINE, 2017, 9 (04) :10-22
[7]   DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs [J].
Chen, Liang-Chieh ;
Papandreou, George ;
Kokkinos, Iasonas ;
Murphy, Kevin ;
Yuille, Alan L. .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (04) :834-848
[8]   Instance-Sensitive Fully Convolutional Networks [J].
Dai, Jifeng ;
He, Kaiming ;
Li, Yi ;
Ren, Shaoqing ;
Sun, Jian .
COMPUTER VISION - ECCV 2016, PT VI, 2016, 9910 :534-549
[9]   How iris recognition works [J].
Daugman, J .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2004, 14 (01) :21-30
[10]   Eye State Classification Based on Multi-feature fusion [J].
Dong, Wenhui ;
Qu, Peishu .
CCDC 2009: 21ST CHINESE CONTROL AND DECISION CONFERENCE, VOLS 1-6, PROCEEDINGS, 2009, :231-234