A Deep Learning Based Light-Weight Face Mask Detector With Residual Context Attention and Gaussian Heatmap to Fight Against COVID-19

被引:22
作者
Fan, Xinqi [1 ]
Jiang, Mingjie [1 ]
Yan, Hong [1 ]
机构
[1] City Univ Hong Kong, Dept Elect Engn, Hong Kong, Peoples R China
关键词
Face recognition; Feature extraction; Faces; Detectors; COVID-19; Convolution; Heating systems; Face mask detection; residual context attention; synthesized Gaussian heat map regression; coronavirus disease 2019;
D O I
10.1109/ACCESS.2021.3095191
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Coronavirus disease 2019 has seriously affected the world. One major protective measure for individuals is to wear masks in public areas. Several regions applied a compulsory mask-wearing rule in public areas to prevent transmission of the virus. Few research studies have examined automatic face mask detection based on image analysis. In this paper, we propose a deep learning based single-shot light-weight face mask detector to meet the low computational requirements for embedded systems, as well as achieve high performance. To cope with the low feature extraction capability caused by the light-weight model, we propose two novel methods to enhance the model's feature extraction process. First, to extract rich context information and focus on crucial face mask related regions, we propose a novel residual context attention module. Second, to learn more discriminating features for faces with and without masks, we introduce a novel auxiliary task using synthesized Gaussian heat map regression. Ablation studies show that these methods can considerably boost the feature extraction ability and thus increase the final detection performance. Comparison with other models shows that the proposed model achieves state-of-the-art results on two public datasets, the AIZOO and Moxa3K face mask datasets. In particular, compared with another light-weight you only look once version 3 tiny model, the mean average precision of our model is 1.7% higher on the AIZOO dataset, and 10.47% higher on the Moxa3K dataset. Therefore, the proposed model has a high potential to contribute to public health care and fight against the coronavirus disease 2019 pandemic.
引用
收藏
页码:96964 / 96974
页数:11
相关论文
共 53 条
[1]  
[Anonymous], 2020, Associated General Contractors of America
[2]  
[Anonymous], 2010, International journal of computer vision, DOI DOI 10.1007/s11263-009-0275-4
[3]   Artificial Intelligence Applied to Chest X-Ray Images for the Automatic Detection of COVID-19. A Thoughtful Evaluation Approach [J].
Arias-Londono, Julian D. ;
Gomez-Garcia, Jorge A. ;
Moro-Velazquez, Laureano ;
Godino-Llorente, Juan, I .
IEEE ACCESS, 2020, 8 :226811-226827
[4]   End-to-End Object Detection with Transformers [J].
Carion, Nicolas ;
Massa, Francisco ;
Synnaeve, Gabriel ;
Usunier, Nicolas ;
Kirillov, Alexander ;
Zagoruyko, Sergey .
COMPUTER VISION - ECCV 2020, PT I, 2020, 12346 :213-229
[5]  
Changjin Li, 2020, AIAM2020: Proceedings of the 2nd International Conference on Artificial Intelligence and Advanced Manufacture, P74, DOI 10.1145/3421766.3421768
[6]   Face Mask Assistant: Detection of Face Mask Service Stage Based on Mobile Phone [J].
Chen, Yuzhen ;
Hu, Menghan ;
Hua, Chunjun ;
Zhai, Guangtao ;
Zhang, Jian ;
Li, Qingli ;
Yang, Simon X. .
IEEE SENSORS JOURNAL, 2021, 21 (09) :11084-11093
[7]   The role of community-wide wearing of face mask for control of coronavirus disease 2019 (COVID-19) epidemic due to SARS-CoV-2 [J].
Cheng, Vincent Chi-Chung ;
Wong, Shuk-Ching ;
Chuang, Vivien Wai-Man ;
So, Simon Yung-Chun ;
Chen, Jonathan Hon-Kwan ;
Sridhar, Siddharth ;
To, Kelvin Kai-Wang ;
Chan, Jasper Fuk-Woo ;
Hung, Ivan Fan-Ngai ;
Ho, Pak-Leung ;
Yuen, Kwok-Yung .
JOURNAL OF INFECTION, 2020, 81 (01) :107-114
[8]   Face masks effectively limit the probability of SARS-CoV-2 transmission [J].
Cheng, Yafang ;
Ma, Nan ;
Witt, Christian ;
Rapp, Steffen ;
Wild, Philipp S. ;
Andreae, Meinrat O. ;
Poschl, Ulrich ;
Su, Hang .
SCIENCE, 2021, 372 (6549) :1439-+
[9]  
Chiang D, 2020, Detecting faces and determine whether people are wearing mask
[10]   Histograms of oriented gradients for human detection [J].
Dalal, N ;
Triggs, B .
2005 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOL 1, PROCEEDINGS, 2005, :886-893