Masked face recognition using frontal and profile faces with multiple fusion levels

被引:4
作者
Alqaralleh, Esraa [1 ]
Afaneh, Ayman [2 ]
Toygar, Onsen [2 ]
机构
[1] Taibah Univ, Khaybar Community Coll, Comp Dept, Al Munawarrah, Saudi Arabia
[2] Eastern Mediterranean Univ, Fac Engn, Comp Engn Dept, Via Mersin 10, Famagusta, North Cyprus, Turkey
关键词
Masked face; Pandemic; Information fusion; Biometrics; Face recognition; SHAPE; EAR;
D O I
10.1007/s11760-022-02345-6
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The main goal of this work is to construct a face recognition system that can overcome the limitation of masked face by exploiting the unmasked parts of frontal and profile faces. This study mainly depends on the upper part of frontal face that contains the eyes and forehead beside of the unmasked parts of profile face such as ear. Many experiments are conducted to measure the efficiency and reliability of face recognition system in case of pandemic where the people have to cover most of their face by mask which makes the process of face recognition harder. Binarized statistical image features approaches is used as texture-based descriptors for feature extraction process beside of convolutional neural networks. Additionally, four fusion approaches are implemented, namely sensor-level, feature-level, score-level and decision-level fusion. Images of frontal and profile face under different conditions from ND-TWINS-2009-2010 and CFPW datasets are used in the experiments. The experimental results show that the proposed method is more reliable and accurate in the case of masked face than using profile or frontal face images as a standalone system. The maximum performance of the proposed method for recognizing masked face as recognition rate is 99.83%. Moreover, the proposed system is better than the state-of-the-art CNN-based and texture-based systems using both frontal and profile faces with and without mask on the faces.
引用
收藏
页码:1375 / 1382
页数:8
相关论文
共 30 条
  • [11] He EJ, 2016, INT CONF ACOUST SPEE, P1293, DOI 10.1109/ICASSP.2016.7471885
  • [12] An introduction to biometric recognition
    Jain, AK
    Ross, A
    Prabhakar, S
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2004, 14 (01) : 4 - 20
  • [13] Kannala J, 2012, INT C PATT RECOG, P1363
  • [14] ImageNet Classification with Deep Convolutional Neural Networks
    Krizhevsky, Alex
    Sutskever, Ilya
    Hinton, Geoffrey E.
    [J]. COMMUNICATIONS OF THE ACM, 2017, 60 (06) : 84 - 90
  • [15] A hybrid deep transfer learning model with machine learning methods for face mask detection in the era of the COVID-19 pandemic
    Loey, Mohamed
    Manogaran, Gunasekaran
    Taha, Mohamed Hamed N.
    Khalifa, Nour Eldeen M.
    [J]. MEASUREMENT, 2021, 167
  • [16] A face recognition system based on convolution neural network using multiple distance face
    Moon, Hae-Min
    Seo, Chang Ho
    Pan, Sung Bum
    [J]. SOFT COMPUTING, 2017, 21 (17) : 4995 - 5002
  • [17] Mundial Imran Qayyum, 2020, 2020 4rd International Conference on Electrical, Telecommunication and Computer Engineering (ELTICOM). Proceedings, P210, DOI 10.1109/ELTICOM50775.2020.9230504
  • [18] A comparative study of texture measures with classification based on feature distributions
    Ojala, T
    Pietikainen, M
    Harwood, D
    [J]. PATTERN RECOGNITION, 1996, 29 (01) : 51 - 59
  • [19] Ojansivu V, 2008, LECT NOTES COMPUT SC, V5099, P236, DOI 10.1007/978-3-540-69905-7_27
  • [20] Phillips P. J., 2011, Proceedings 2011 IEEE International Conference on Automatic Face & Gesture Recognition (FG 2011), P185, DOI 10.1109/FG.2011.5771395