Optical-Nanofiber-Enabled Gesture-Recognition Wristband for Human-Machine Interaction with the Assistance of Machine Learning

被引:16
作者
Wang, Shipeng [1 ]
Wang, Xiaoyu [1 ]
Wang, Shan [1 ]
Yu, Wen [2 ]
Yu, Longteng [1 ]
Hou, Lei [1 ]
Tang, Yao [2 ]
Zhang, Zhang [3 ]
Yao, Ni [1 ]
Cao, Chuan [1 ]
Dong, Hao [1 ]
Zhang, Lei [1 ,2 ]
Bao, Hujun [4 ]
机构
[1] Zhejiang Lab, Res Ctr Humanoid Sensing, Hangzhou 311121, Peoples R China
[2] Zhejiang Univ, Coll Opt Sci & Engn, State Key Lab Modern Opt Instrumentat, Hangzhou 310027, Peoples R China
[3] Zhejiang Lab, Res Ctr Intelligent Robot, Hangzhou 311121, Peoples R China
[4] Zhejiang Lab, Hangzhou 311121, Peoples R China
基金
中国国家自然科学基金;
关键词
gesture-recognition wristbands; human-machine interactions; machine learning; metaverse; optical nanofibers; SENSOR; IDENTIFICATION;
D O I
10.1002/aisy.202200412
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The metaverse, where the virtual and real world are fused, is currently under rapid development. Immersive and vivid experience in the metaverse requires human-machine interaction devices that, unlike those currently available, are simultaneously imperceptible, convenient to use, inexpensive, and safe. Herein, an optical-nanofiber-based gesture-recognition wristband that can accurately recognize gestures and be used to interact with a robotic hand is proposed and realized. Requiring only three optical-nanofiber-based pressure sensors, the wristband is simple in structure, convenient to use, and remarkably imperceptible to the user. With the assistance of a machine-learning algorithm, a maximum recognition accuracy of 94% is achieved for testers with different physiques. A robotic hand can be remotely controlled by the wristband through gestures. The wristband has broad application prospects and is a promising solution for advanced human-machine-interaction devices. An interactive preprint version of the article can be found here: .
引用
收藏
页数:8
相关论文
共 41 条
  • [1] Stretchable distributed fiber-optic sensors
    Bai, Hedan
    Li, Shuo
    Barreiros, Jose
    Tu, Yaqi
    Pollock, Clifford R.
    Shepherd, Robert F.
    [J]. SCIENCE, 2020, 370 (6518) : 848 - +
  • [2] The Ultimate Strength of Glass Silica Nanowires
    Brambilla, Gilberto
    Payne, David N.
    [J]. NANO LETTERS, 2009, 9 (02) : 831 - 835
  • [3] Alignment-Free Liquid-Capsule Pressure Sensor for Cardiovascular Monitoring
    Fan, Xiangyu
    Huang, Yan
    Ding, Xiaorong
    Luo, Ningqi
    Li, Chenglin
    Zhao, Ni
    Chen, Shih-Chi
    [J]. ADVANCED FUNCTIONAL MATERIALS, 2018, 28 (44)
  • [4] Bioinspired Self-Healing Human-Machine Interactive Touch Pad with Pressure-Sensitive Adhesiveness on Targeted Substrates
    Gao, Guorong
    Yang, Fangjian
    Zhou, Fenghua
    He, Jiang
    Lu, Wei
    Xiao, Peng
    Yan, Huizhen
    Pan, Caofeng
    Chen, Tao
    Wang, Zhong Lin
    [J]. ADVANCED MATERIALS, 2020, 32 (50)
  • [5] Gesture recognition by instantaneous surface EMG images
    Geng, Weidong
    Du, Yu
    Jin, Wenguang
    Wei, Wentao
    Hu, Yu
    Li, Jiajun
    [J]. SCIENTIFIC REPORTS, 2016, 6
  • [6] Highly flexible and stretchable optical strain sensing for human motion detection
    Guo, Jingjing
    Niu, Mengxuan
    Yang, Changxi
    [J]. OPTICA, 2017, 4 (10): : 1285 - 1288
  • [7] Functional Materials and Devices for XR (VR/AR/MR) Applications
    Ko, Seung Hwan
    Rogers, John
    [J]. ADVANCED FUNCTIONAL MATERIALS, 2021, 31 (39)
  • [8] Stretchable Thermoplastic Elastomer Optical Fibers for Sensing of Extreme Deformations
    Leber, Andreas
    Cholst, Beth
    Sandt, Joseph
    Vogel, Nicolas
    Kolle, Mathias
    [J]. ADVANCED FUNCTIONAL MATERIALS, 2019, 29 (05)
  • [9] Sensitive and Wearable Optical Microfiber Sensor for Human Health Monitoring
    Li, Jin-hong
    Chen, Jin-hui
    Xu, Fei
    [J]. ADVANCED MATERIALS TECHNOLOGIES, 2018, 3 (12):
  • [10] Wearable Alignment-Free Microfiber-Based Sensor Chip for Precise Vital Signs Monitoring and Cardiovascular Assessment
    Li, Liangye
    Liu, Yunfei
    Song, Changying
    Sheng, Shunfeng
    Yang, Liuyang
    Yan, Zhijun
    Hu, Dora Juan Juan
    Sun, Qizhen
    [J]. ADVANCED FIBER MATERIALS, 2022, 4 (03) : 475 - 486