airFinger: Micro finger Gesture Recognition via NIR Light Sensing for Smart Devices

被引:5
作者
Zhang, Qian [1 ,2 ]
Cao, Yetong [2 ]
Chen, Huijie [2 ]
Li, Fan [2 ]
Yang, Song [2 ]
Wang, Yu [3 ]
Yang, Zheng [1 ]
Liu, Yunhao [1 ]
机构
[1] Tsinghua Univ, Beijing, Peoples R China
[2] Beijing Inst Technol, Beijing, Peoples R China
[3] Temple Univ, Philadelphia, PA 19122 USA
来源
2020 IEEE 40TH INTERNATIONAL CONFERENCE ON DISTRIBUTED COMPUTING SYSTEMS (ICDCS) | 2020年
关键词
micro finger gesture; light sensor; gesture recognition; interaction;
D O I
10.1109/ICDCS47774.2020.00073
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Micro linger gesture recognition is an emerging approach to realize more friendly interaction between human and smart devices, especially for small wearable devices, such as smartwatches and virtual reality glasses. This paper proposes airFinger, a novel solution utilizing NIR light sensing to realize both real-time gesture recognition and linger tracking aiming at micro finger gestures. Using a custom NIR-based sensor with novel algorithms to capture subtle linger movements, airFinger enables to detect a rich set of micro finger gestures and track finger movements in terms of scrolling direction, velocity, and displacement. Besides, airFinger is capable of effective noise mitigation, gesture segmentation, and reducing false recognition due to the unintentional actions of users. Extensive experimental results demonstrate that airFinger has robustness against individual diversity, gesture inconsistency, and many other impacts. The overall performance reaches an average accuracy as high as 98.72% over a set of 8 micro finger gestures among 10,000 gesture samples collected from 10 volunteers.
引用
收藏
页码:552 / 562
页数:11
相关论文
共 39 条
[1]  
Abdelnasser H, 2015, IEEE CONF COMPUT, P17, DOI 10.1109/INFCOMW.2015.7179321
[2]  
[Anonymous], 2018, IEEE Transactions on Cybernetics
[3]  
[Anonymous], 2014, P 27 ANN ACM S US IN, DOI [DOI 10.1145/2642918, 10.1145/2642918]
[4]   CID: an efficient complexity-invariant distance for time series [J].
Batista, Gustavo E. A. P. A. ;
Keogh, Eamonn J. ;
Tataw, Oben Moses ;
de Souza, Vinicius M. A. .
DATA MINING AND KNOWLEDGE DISCOVERY, 2014, 28 (03) :634-669
[5]  
Chan L., 2013, P 26 ANN ACM S US IN, P255, DOI DOI 10.1145/2501988.2502016
[6]  
Chen K.-Y., 2013, Proceedings of the 26th annual ACM symposium on User interface software and technology, P237, DOI DOI 10.1145/2501988.2502035
[7]   Pyro: Thumb-Tip Gesture Recognition Using Pyroelectric Infrared Sensing [J].
Gong, Jun ;
Zhang, Yang ;
Zhou, Xia ;
Yang, Xing-Dong .
UIST'17: PROCEEDINGS OF THE 30TH ANNUAL ACM SYMPOSIUM ON USER INTERFACE SOFTWARE AND TECHNOLOGY, 2017, :553-563
[8]   Automated Image Quality Assessment for Certificates and Bills [J].
Jiang, Fei ;
Zhang, Liang-Jie ;
Chen, Huan .
2017 IEEE 1ST INTERNATIONAL CONFERENCE ON COGNITIVE COMPUTING (ICCC 2017), 2017, :1-8
[9]   Accuracy and Resolution of Kinect Depth Data for Indoor Mapping Applications [J].
Khoshelham, Kourosh ;
Elberink, Sander Oude .
SENSORS, 2012, 12 (02) :1437-1454
[10]  
Kim D, 2012, UIST'12: PROCEEDINGS OF THE 25TH ANNUAL ACM SYMPOSIUM ON USER INTERFACE SOFTWARE AND TECHNOLOGY, P167