RGB-D Video based Hand Authentication using Deep Neural Networks

In recent years, behavioral biometrics authentication, which uses the habit of behavioral characteristics for personal authentication, has attracted attention as an authentication method with higher security since behavioral biometrics cannot mimic fingerprint and face authentications. In behavioral biometrics, extensive research has been done on voiceprints and gait. However, there are few authentication technologies that utilize the habits of hand and finger movements during hand gestures. Only color images or depth images are used for hand gesture authentication in conventional methods. In this research, therefore, we propose to find individual habits from RGB-D images of finger movements and create a personal authentication system. 3D CNN, which is deep learning-based network, is used to extract individual habits. F-measure of 0.97 is achieved when rock-paper-scissors are used as the authentication operation. F-measure of 0.97 is achieved when the disinfection operation is used. These results show the effectiveness of using RGB-D video for personal authentication. (C) 2023 Society for Imaging Science and Technology.