Towards Position-Independent Sensing for Gesture Recognition with Wi-Fi

被引:90
作者
Gao, Ruiyang [1 ]
Zhang, Mi [2 ]
Zhang, Jie [1 ]
Li, Yang [1 ]
Yi, Enze [1 ]
Wu, Dan [1 ]
Wang, Leye [1 ]
Zhang, Daqing [3 ,4 ]
机构
[1] Peking Univ, Sch Elect Engn & Comp Sci, Beijing, Peoples R China
[2] Michigan State Univ, E Lansing, MI 48824 USA
[3] Peking Univ, Minist Educ, Sch Elect Engn & Comp Sci, Key Lab High Confidence Software Technol, Beijing, Peoples R China
[4] Inst Polytech Paris, Telecom SudParis, Evry, France
来源
PROCEEDINGS OF THE ACM ON INTERACTIVE MOBILE WEARABLE AND UBIQUITOUS TECHNOLOGIES-IMWUT | 2021年 / 5卷 / 02期
关键词
Gesture Recognition; Wireless Sensing; Channel State Information (CSI);
D O I
10.1145/3463504
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Past decades have witnessed the extension of the Wi-Fi signals as a useful tool sensing human activities. One common assumption behind it is that there is a one-to-one mapping between human activities and Wi-Fi received signal patterns. However, this assumption does not hold when the user conducts activities in different locations and orientations. Actually, the received signal patterns of the same activity would become inconsistent when the relative location and orientation of the user with respect to transceivers change, leading to unstable sensing performance. This problem is known as the position-dependent problem, hindering the actual deployment of Wi-Fi-based sensing applications. In this paper, to tackle this fundamental problem, we develop a new position-independent sensing strategy and use gesture recognition as an application example to demonstrate its effectiveness. The key idea is to shift our observation from the traditional transceiver view to the hand-oriented view, and extract features that are irrespective of position-specific factors. Following the strategy, we design a position-independent feature, denoted as Motion Navigation Primitive(MNP). MNP captures the pattern of moving direction changes of the hand, which shares consistent patterns when the user performs the same gesture with different position-specific factors. By analyzing the pattern of MNP, we convert gestures into sequences of strokes(e.g, line, arc and corner) which makes them easy to be recognized. We build a prototype WiFi gesture recognition system,i.e., WiGesture to validate the effectiveness of the proposed strategy. Experiments show that our system can outperform the start-of-arts significantly in different settings. Given its novelty and superiority, we believe the proposed method symbolizes a major step towards gesture recognition and would inspire other solutions to position-independent activity recognition in the future.
引用
收藏
页数:28
相关论文
共 44 条
[1]  
Abdelnasser H, 2015, IEEE CONF COMPUT, P17, DOI 10.1109/INFCOMW.2015.7179321
[2]   Keystroke Recognition Using WiFi Signals [J].
Ali, Kamran ;
Liu, Alex X. ;
Wang, Wei ;
Shahzad, Muhammad .
MOBICOM '15: PROCEEDINGS OF THE 21ST ANNUAL INTERNATIONAL CONFERENCE ON MOBILE COMPUTING AND NETWORKING, 2015, :90-102
[3]  
Cao XX, 2016, IEEE TRUST, P1366, DOI [10.1109/TrustCom.2016.0216, 10.1109/TrustCom.2016.214]
[4]  
Fang Biyi, 2016, 14 ACM C MOBILE SYST
[5]  
Funasaka M., 2015, Proceedings of the International Conference on Parallel and Distributed Processing Techniques and Applications (PDPTA), P263
[6]   From fresnel diffraction model to fine-grained human respiration sensing with commodity Wi-Fi devices [J].
Zhang, Fusang ;
Zhang, Daqing ;
Xiong, Jie ;
Wang, Hao ;
Niu, Kai ;
Jin, Beihong ;
Wang, Yuxiang .
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 2018, 2 (01)
[7]  
Google, PROJ SOL
[8]   Tool Release: Gathering 802.11n Traces with Channel State Information [J].
Halperin, Daniel ;
Hu, Wenjun ;
Sheth, Anmol ;
Wetherall, David .
ACM SIGCOMM COMPUTER COMMUNICATION REVIEW, 2011, 41 (01) :53-53
[9]  
Jenkins FrancisA., 1937, FUNDAMENTALS OPTICS
[10]   WiFit: Ubiquitous Bodyweight Exercise Monitoring with Commodity Wi-Fi Devices [J].
Li, Shengjie ;
Li, Xiang ;
Lv, Qin ;
Tian, Guiyu ;
Zhang, Daqing .
2018 IEEE SMARTWORLD, UBIQUITOUS INTELLIGENCE & COMPUTING, ADVANCED & TRUSTED COMPUTING, SCALABLE COMPUTING & COMMUNICATIONS, CLOUD & BIG DATA COMPUTING, INTERNET OF PEOPLE AND SMART CITY INNOVATION (SMARTWORLD/SCALCOM/UIC/ATC/CBDCOM/IOP/SCI), 2018, :530-537