VibWriter: Handwriting Recognition System based on Vibration Signal

被引:2
作者
Ding, Dian [1 ]
Yang, Lanqing [1 ]
Chen, Yi-Chao [1 ]
Xue, Guangtao [1 ]
机构
[1] Shanghai Jiao Tong Univ, Dept Comp Sci & Engn, Shanghai, Peoples R China
来源
2021 18TH ANNUAL IEEE INTERNATIONAL CONFERENCE ON SENSING, COMMUNICATION, AND NETWORKING (SECON) | 2021年
关键词
vibration signal; handwriting recognition;
D O I
10.1109/SECON52354.2021.9491615
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
The efficiency of human-computer interaction is greatly hindered by the small size of the touchscreens on mobile devices, such as smart phones and watches. This has prompted widespread interest in handwriting recognition systems, which can be divided into active and passive systems. Active systems require additional hardware devices to perceive movements of handwriting or the tracking accuracy is not adequate for handwriting recognition. Passive methods use the acoustic signal of pen rubbing and are susceptible to environmental noise (above 60dB). This paper presents a novel handwriting recognition system based on vibration signals detected by the built-in accelerometer of smart phones. VibWriter is highly resistant to interference since the normal environmental noise will not cause the vibration of the accelerometer. Extensive experiments demonstrated the efficacy of the system in terms of accuracy in letter recognition (76.15%) and word recognition (88.14%) when dealing with words of various lengths written by various users in a variety of writing positions under a variety of environmental conditions.
引用
收藏
页数:9
相关论文
共 32 条
[1]  
Anand S. A., 2019, SPEARPHONE SPEECH PR
[2]   Learning-based Practical Smartphone Eavesdropping with Built-in Accelerometer [J].
Ba, Zhongjie ;
Zheng, Tianhang ;
Zhang, Xinyu ;
Qin, Zhan ;
Li, Baochun ;
Liu, Xue ;
Ren, Kui .
27TH ANNUAL NETWORK AND DISTRIBUTED SYSTEM SECURITY SYMPOSIUM (NDSS 2020), 2020,
[3]   Xception: Deep Learning with Depthwise Separable Convolutions [J].
Chollet, Francois .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :1800-1807
[4]   GyroPen: Gyroscopes for Pen-Input With Mobile Phones [J].
Deselaers, Thomas ;
Keysers, Daniel ;
Hosang, Jan ;
Rowley, Henry A. .
IEEE TRANSACTIONS ON HUMAN-MACHINE SYSTEMS, 2015, 45 (02) :263-271
[5]  
Du HS, 2018, IEEE INFOCOM SER, P1448, DOI 10.1109/INFOCOM.2018.8486285
[6]   Linear Methods for Image Interpolation [J].
Getreuer, Pascal .
IMAGE PROCESSING ON LINE, 2011, 1 :238-259
[7]   Predefined-Time Distributed Optimal Allocation of Resources: A Time-Base Generator Scheme [J].
Guo, Zhijun ;
Chen, Gang .
IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2022, 52 (01) :438-447
[8]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[9]   Motion Eavesdropper: Smartwatch-based Handwriting Recognition Using Deep Learning [J].
Jiang, Hao ;
Wang, Dong ;
Zhang, Qian ;
Zhao, Run .
ICMI'19: PROCEEDINGS OF THE 2019 INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION, 2019, :145-153
[10]   Focal Loss for Dense Object Detection [J].
Lin, Tsung-Yi ;
Goyal, Priya ;
Girshick, Ross ;
He, Kaiming ;
Dollar, Piotr .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :2999-3007