Direction-agnostic gesture recognition system using commercial WiFi devices

被引:3
作者
Qin, Yuxi [1 ]
Sigg, Stephan [2 ]
Pan, Su [1 ]
Li, Zibo [1 ]
机构
[1] Nanjing Univ Posts & Telecommun, Sch Commun & Informat Engn, Nanjing 210003, Peoples R China
[2] Aalto Univ, Dept Commun & Networking, Espoo 02180, Finland
基金
中国国家自然科学基金;
关键词
Channel state information; Direction-agnostic; Hand gesture recognition; HAND GESTURES;
D O I
10.1016/j.comcom.2023.12.033
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In recent years, channel state information (CSI) has been used to recognize hand gestures for contactless human-computer interaction. However, most existing solutions require precision hardware or prior learning at the same angle both during training and for inference/training in order to achieve high recognition accuracy. This requirement is unrealistic for practical instrumentation, where the orientation of a subject relative to the RF receiver may be arbitrary. We present direction -agnostic hand gesture recognition utilizing commercial WiFi devices to overcome low accuracy in non -trained observation angles. To achieve equal conditions in all recognition angles, first of all, through the circular antenna arrangement to mitigate the impact of user direction changes. Then, the orientation of users is estimated by the Fresnel zone model. Finally, the feature mapping model of users in different orientations is established, and the gesture features in the estimated direction are mapped to the benchmark direction to eliminate the influence caused by the change of user orientation. Experimental results in a typical indoor environment show that WiNDR has superior performance, and the average recognition accuracy of five common gestures is 92.38%.
引用
收藏
页码:34 / 44
页数:11
相关论文
共 40 条
[1]   Toward User-Independent Emotion Recognition Using Physiological Signals [J].
Albraikan, Amani ;
Tobon, Diana P. ;
El Saddik, Abdulmotaleb .
IEEE SENSORS JOURNAL, 2019, 19 (19) :8402-8412
[2]   Robust Hand Gestures Recognition Using a Deep CNN and Thermal Images [J].
Breland, Daniel Skomedal ;
Dayal, Aveen ;
Jha, Ajit ;
Yalavarthy, Phaneendra K. ;
Pandey, Om Jee ;
Cenkeramaddi, Linga Reddy .
IEEE SENSORS JOURNAL, 2021, 21 (23) :26602-26614
[3]   Contactless Body Movement Recognition During Sleep via WiFi Signals [J].
Cao, Yangjie ;
Wang, Fuchao ;
Lu, Xinxin ;
Lin, Nan ;
Zhang, Bo ;
Liu, Zhi ;
Sigg, Stephan .
IEEE INTERNET OF THINGS JOURNAL, 2020, 7 (03) :2028-2037
[4]   Towards Position-Independent Sensing for Gesture Recognition with Wi-Fi [J].
Gao, Ruiyang ;
Zhang, Mi ;
Zhang, Jie ;
Li, Yang ;
Yi, Enze ;
Wu, Dan ;
Wang, Leye ;
Zhang, Daqing .
PROCEEDINGS OF THE ACM ON INTERACTIVE MOBILE WEARABLE AND UBIQUITOUS TECHNOLOGIES-IMWUT, 2021, 5 (02)
[5]   From Signal to Image: Capturing Fine-Grained Human Poses With Commodity Wi-Fi [J].
Guo, Lingchao ;
Lu, Zhaoming ;
Wen, Xiangming ;
Zhou, Shuang ;
Han, Zijun .
IEEE COMMUNICATIONS LETTERS, 2020, 24 (04) :802-806
[6]   In-Air Handwriting by Passive Gesture Tracking Using Commodity WiFi [J].
Han, Zijun ;
Lu, Zhaoming ;
Wen, Xiangming ;
Zhao, Jingbo ;
Guo, Lingchao ;
Liu, Yue .
IEEE COMMUNICATIONS LETTERS, 2020, 24 (11) :2652-2656
[7]  
Hao Zhanjun, 2021, 2021 IEEE 23rd Int Conf on High Performance Computing & Communications
[8]  
7th Int Conf on Data Science & Systems
[9]  
19th Int Conf on Smart City
[10]  
7th Int Conf on Dependability in Sensor, Cloud & Big Data Systems & Application (HPCC/DSS/SmartCity/DependSys)., P26, DOI 10.1109/HPCC-DSS-SmartCity-DependSys53884.2021.00031