A vision-based hand hygiene monitoring approach using self-attention convolutional neural network

被引：0

作者：

Xie, Tianming ^{[1
,2
]}

Tian, Jing ^{[3
]}

Ma, Lihong ^{[1
,2
]}

机构：

[1] School of Electronics & Information Engineering, South China University of Technology, Guangzhou, China

[2] National Research Center for Mobile Ultrasonic Detection, Guangzhou, China

[3] Institute of Systems Science, National University of Singapore, Singapore,119615, Singapore

来源：

Biomedical Signal Processing and Control | 2022年 / 76卷

关键词：

Convolution - Palmprint recognition - Neural network models;

D O I：

暂无

中图分类号：

学科分类号：

摘要：

Automatic hand hygiene monitoring is an effective and necessary practice in healthcare. The main objective is to automate the quality control of the hand hygiene process by recognizing handwashing actions. This paper proposes a new computer vision-based hand hygiene monitoring approach, with the aim to recognize handwashing actions from the input videos. The proposed approach consists of the following three modules. First, in the feature extraction module, a backbone convolutional neural network (CNN) model (i.e., a ResNet model) is used to extract features from each frame of the input video. Second, in the feature aggregation module, the self-attention mechanism is introduced to form six masked self-attention blocks that are stacked to aggregate features from multiple frames. Third, in the feature classification module, the self-attentive aggregated feature representation is used for handwashing action recognition. The proposed approach outperforms a few state-of-the-art handwashing action recognition approaches. The proposed approach is able to perform effective and accurate handwashing action recognition for automatic hand hygiene monitoring, as verified by three benchmark datasets. © 2022 Elsevier Ltd

引用