An AVOA-LSTM with MRCNN for segmenting and classifying the sunglass image-based eye region identification

被引:0
作者
Divya, A. K. [1 ]
Keshaveni, N. [2 ]
机构
[1] VTU, KVG Coll Engn, CS&E Dept, Belagavi, India
[2] VTU, KVG Coll Engn, E&CE Dept, Belagavi, India
关键词
Mask-RCNN; OLSTM; eye region; AVOA; Segmentation; Classification; Deep Learning; RECOGNITION; FACE; TRACKING; FATIGUE;
D O I
10.1007/s11042-023-16800-0
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The recognition of the eye region from images is a challenging task, particularly when dealing with dark or thick sunglasses that cause reflections and interfere with accurate identification. To address this issue, a novel system called AVOA-MRCNN-OLSTM has been proposed. This system combines Optimization-driven Long Short-Term Memory (LSTM) with Mask RCNN to achieve precise eye recognition even in the presence of eyeglass frame interference. A mean histogram equalization approach is used in the system's first stage to eliminate noise, which improves the image quality. The system then uses Mask RCNN for segmentation and localization. A potent deep learning model called Mask RCNN can precisely recognize and isolate particular items inside an image. It is used in this instance to identify and divide the eye region. The AVOA-MRCNN-OLSTM framework makes use of LSTM, a recurrent neural network variety that can retain patterns for longer periods. It can efficiently acquire and use temporal information to increase eye recognition accuracy by integrating LSTM into the system. The proposed AVOA-MRCNN-OLSTM system's effectiveness is shown by experimental findings. It outperforms the performance of existing algorithms, achieving a remarkable accuracy of 99% in just 0.02 seconds of computing time. The potential uses of this development include biometric identity, surveillance systems, and human-computer interfaces, all of which need precise eye recognition.
引用
收藏
页码:35073 / 35095
页数:23
相关论文
共 28 条
[1]   A Face in any Form: New Challenges and Opportunities for Face Recognition Technology [J].
Akhtar, Zahid ;
Rattani, Ajita .
COMPUTER, 2017, 50 (04) :80-90
[2]  
Anitha C, 2019, LECT NOTE DATA ENG, V21, P157, DOI 10.1007/978-3-319-93940-7_7
[3]  
Chellappa R, 2016, 2016 INFORMATION THEORY AND APPLICATIONS WORKSHOP (ITA)
[4]   Unobtrusive and pervasive video-based eye-gaze tracking [J].
Cristina, Stefania ;
Camilleri, Kenneth P. .
IMAGE AND VISION COMPUTING, 2018, 74 :21-40
[5]   Hybrid computer vision system for drivers' eye recognition and fatigue monitoring [J].
Cyganek, Boguslaw ;
Gruszczynski, Slawomir .
NEUROCOMPUTING, 2014, 126 :78-94
[6]   Occlusion-Aware 3D Morphable Models and an Illumination Prior for Face Image Analysis [J].
Egger, Bernhard ;
Schonborn, Sandro ;
Schneider, Andreas ;
Kortylewski, Adam ;
Morel-Forster, Andreas ;
Blumer, Clemens ;
Vetter, Thomas .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2018, 126 (12) :1269-1287
[7]   Pupil detection for head-mounted eye tracking in the wild: an evaluation of the state of the art [J].
Fuhl, Wolfgang ;
Tonsen, Marc ;
Bulling, Andreas ;
Kasneci, Enkelejda .
MACHINE VISION AND APPLICATIONS, 2016, 27 (08) :1275-1288
[8]   Gaze Estimation in the 3D Space Using RGB-D Sensors [J].
Funes-Mora, Kenneth A. ;
Odobez, Jean-Marc .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2016, 118 (02) :194-216
[9]   A joint cascaded framework for simultaneous eye detection and eye state estimation [J].
Gou, Chao ;
Wu, Yue ;
Wang, Kang ;
Wang, Kunfeng ;
Wang, Fei-Yue ;
Ji, Qiang .
PATTERN RECOGNITION, 2017, 67 :23-31
[10]   Facial expression recognition with automatic segmentation of face regions using a fuzzy based classification approach [J].
Hernandez-Matamoros, Andres ;
Bonarini, Andrea ;
Escamilla-Hernandez, Enrique ;
Nakano-Miyatake, Mariko ;
Perez-Meana, Hector .
KNOWLEDGE-BASED SYSTEMS, 2016, 110 :1-14