A Deep Convolutional Neural Network to Limit Virus Spread Using Facial Mask Segmentation

被引:1
作者
Lefloch, D. [1 ]
Wang, J. M. [1 ]
机构
[1] Tiangong Univ, Software Engn Dept, Tianjin 300387, Peoples R China
来源
JOURNAL OF WEB ENGINEERING | 2021年 / 20卷 / 04期
关键词
Mask segmentation; face detection; convolutional neural networks; deep learning;
D O I
10.13052/jwe1540-9589.20414
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Due to the recent COVID-19 outbreak the world has experienced many challenges. Limit and control the virus spread rate is one of them. This letter focuses on limiting the speed of virus spreading by monitoring the use of facial mask in crowded public environments such as tourism places, commercial centres, etc. The proposed method first accurately localizes faces using a state-of-the-art approach and, segments facial mask in a second step. The facial mask segmentation allows to distinguish whether the current subject is wearing a facial mask or not but also if it is properly covering the human face. Indeed, most recent face detection algorithms provide as output a set of facial features such as nose tip and mouth corners. By combining these facial features with facial mask segmentation, the proposed method detects real-time subjects that indirectly encourage virus spread in crowded environments. The proposed facial mask segmentation model is trained with pairs of RGB images and its corresponding alpha image created by extending the publicly available real-world masked face dataset. Further, the proposed model is pruned and optimized using the TensorRt library to be usable for real-world applications.
引用
收藏
页码:1177 / 1188
页数:12
相关论文
共 18 条
[1]  
Centers for Disease Control and Prevention (CDC), WEAR MASKS
[2]   ArcFace: Additive Angular Margin Loss for Deep Face Recognition [J].
Deng, Jiankang ;
Guo, Jia ;
Xue, Niannan ;
Zafeiriou, Stefanos .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :4685-4694
[3]   Supervised Transformer Network for Efficient Face Detection [J].
Chen, Dong ;
Hua, Gang ;
Wen, Fang ;
Sun, Jian .
COMPUTER VISION - ECCV 2016, PT V, 2016, 9909 :122-138
[4]   Face Detection and Segmentation Based on Improved Mask R-CNN [J].
Lin, Kaihan ;
Zhao, Huimin ;
Lv, Jujian ;
Li, Canyao ;
Liu, Xiaoyong ;
Chen, Rongjun ;
Zhao, Ruoyan .
DISCRETE DYNAMICS IN NATURE AND SOCIETY, 2020, 2020
[5]   Joint Face Alignment and 3D Face Reconstruction [J].
Liu, Feng ;
Zeng, Dan ;
Zhao, Qijun ;
Liu, Xiaoming .
COMPUTER VISION - ECCV 2016, PT V, 2016, 9909 :545-560
[6]   Deep Learning Face Attributes in the Wild [J].
Liu, Ziwei ;
Luo, Ping ;
Wang, Xiaogang ;
Tang, Xiaoou .
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, :3730-3738
[7]  
Lodh A., 2020, P 2020 4 INT C ELECT, P1361
[8]   A hybrid deep transfer learning model with machine learning methods for face mask detection in the era of the COVID-19 pandemic [J].
Loey, Mohamed ;
Manogaran, Gunasekaran ;
Taha, Mohamed Hamed N. ;
Khalifa, Nour Eldeen M. .
MEASUREMENT, 2021, 167
[9]  
Manik M. M. H., 2020, IEEE INT IOT ELECT M, P1
[10]   Learning Deconvolution Network for Semantic Segmentation [J].
Noh, Hyeonwoo ;
Hong, Seunghoon ;
Han, Bohyung .
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, :1520-1528