Augmented tactile-perception and haptic-feedback rings as human-machine interfaces aiming for immersive interactions

被引:296
作者
Sun, Zhongda [1 ,2 ,3 ,4 ,5 ]
Zhu, Minglu [1 ,2 ,3 ,5 ]
Shan, Xuechuan [4 ,6 ]
Lee, Chengkuo [1 ,2 ,3 ,4 ,5 ,7 ]
机构
[1] Natl Univ Singapore, Dept Elect & Comp Engn, 4 Engn Dr 3, Singapore 117583, Singapore
[2] Natl Univ Singapore, Ctr Intelligent Sensors, 4 Engn Dr 3, Singapore 117583, Singapore
[3] Natl Univ Singapore, MEMS, 4 Engn Dr 3, Singapore 117583, Singapore
[4] Natl Univ Singapore, Singapore Inst Mfg Technol & Natl Univ Singapore, 4 Engn Dr 3, Singapore 117583, Singapore
[5] Natl Univ Singapore, Suzhou Res Inst NUSRI, Suzhou Ind Pk, Suzhou 215123, Peoples R China
[6] ASTAR, Singapore Inst Mfg Technol, Printed Intelligent Device Grp, Singapore 637662, Singapore
[7] Natl Univ Singapore, NUS Grad Sch, Integrat Sci & Engn Program ISEP, Singapore 119077, Singapore
关键词
PYROELECTRIC NANOGENERATORS; NANOWIRE HEATER; DEVICES; ROBOT;
D O I
10.1038/s41467-022-32745-8
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Current wearable solutions for Virtual Reality (VR) have limitations of complicated structures and large driven power. Here, the authors report a highly integrated ring consisting of multimodal sensing and feedback units for augmented interactions in metaverse. Advancements of virtual reality technology pave the way for developing wearable devices to enable somatosensory sensation, which can bring more comprehensive perception and feedback in the metaverse-based virtual society. Here, we propose augmented tactile-perception and haptic-feedback rings with multimodal sensing and feedback capabilities. This highly integrated ring consists of triboelectric and pyroelectric sensors for tactile and temperature perception, and vibrators and nichrome heaters for vibro- and thermo-haptic feedback. All these components integrated on the ring can be directly driven by a custom wireless platform of low power consumption for wearable/portable scenarios. With voltage integration processing, high-resolution continuous finger motion tracking is achieved via the triboelectric tactile sensor, which also contributes to superior performance in gesture/object recognition with artificial intelligence analysis. By fusing the multimodal sensing and feedback functions, an interactive metaverse platform with cross-space perception capability is successfully achieved, giving people a face-to-face like immersive virtual social experience.
引用
收藏
页数:13
相关论文
共 70 条
  • [51] Hierarchically patterned self-powered sensors for multifunctional tactile sensing
    Wang, Yang
    Wu, Heting
    Xu, Lin
    Zhang, Hainan
    Yang, Ya
    Wang, Zhong Lin
    [J]. SCIENCE ADVANCES, 2020, 6 (34):
  • [52] Graphene-Polymer Nanocomposite-Based Redox-Induced Electricity for Flexible Self-Powered Strain Sensors
    Wang, Yuanming
    Wang, Yang
    Yang, Ya
    [J]. ADVANCED ENERGY MATERIALS, 2018, 8 (22)
  • [53] AI enabled sign language recognition and VR space bidirectional communication using triboelectric smart glove
    Wen, Feng
    Zhang, Zixuan
    He, Tianyiyi
    Lee, Chengkuo
    [J]. NATURE COMMUNICATIONS, 2021, 12 (01)
  • [54] Machine Learning Glove Using Self-Powered Conductive Superhydrophobic Triboelectric Textile for Gesture Recognition in VR/AR Applications
    Wen, Feng
    Sun, Zhongda
    He, Tianyiyi
    Shi, Qiongfeng
    Zhu, Minglu
    Zhang, Zixuan
    Li, Lianhui
    Zhang, Ting
    Lee, Chengkuo
    [J]. ADVANCED SCIENCE, 2020, 7 (14)
  • [55] Pyroelectric Nanogenerators for Driving Wireless Sensors
    Yang, Ya
    Wang, Sihong
    Zhang, Yan
    Wang, Zhong Lin
    [J]. NANO LETTERS, 2012, 12 (12) : 6408 - 6413
  • [56] Flexible Pyroelectric Nanogenerators using a Composite Structure of Lead-Free KNbO3 Nanowires
    Yang, Ya
    Jung, Jong Hoon
    Yun, Byung Kil
    Zhang, Fang
    Pradel, Ken C.
    Guo, Wenxi
    Wang, Zhong Lin
    [J]. ADVANCED MATERIALS, 2012, 24 (39) : 5357 - 5362
  • [57] Single Micro/Nanowire Pyroelectric Nanogenerators as Self-Powered Temperature Sensors
    Yang, Ya
    Zhou, Yusheng
    Wu, Jyh Ming
    Wang, Zhong Lin
    [J]. ACS NANO, 2012, 6 (09) : 8456 - 8461
  • [58] Pyroelectric Nanogenerators for Harvesting Thermoelectric Energy
    Yang, Ya
    Guo, Wenxi
    Pradel, Ken C.
    Zhu, Guang
    Zhou, Yusheng
    Zhang, Yan
    Hu, Youfan
    Lin, Long
    Wang, Zhong Lin
    [J]. NANO LETTERS, 2012, 12 (06) : 2833 - 2838
  • [59] Skin-integrated wireless haptic interfaces for virtual and augmented reality
    Yu, Xinge
    Xie, Zhaoqian
    Yu, Yang
    Lee, Jungyup
    Vazquez-Guardado, Abraham
    Luan, Haiwen
    Ruben, Jasper
    Ning, Xin
    Akhtar, Aadeel
    Li, Dengfeng
    Ji, Bowen
    Liu, Yiming
    Sun, Rujie
    Cao, Jingyue
    Huo, Qingze
    Zhong, Yishan
    Lee, ChanMi
    Kim, SeungYeop
    Gutruf, Philipp
    Zhang, Changxing
    Xue, Yeguang
    Guo, Qinglei
    Chempakasseril, Aditya
    Tian, Peilin
    Lu, Wei
    Jeong, JiYoon
    Yu, YongJoon
    Cornman, Jesse
    Tan, CheeSim
    Kirn, BongHoon
    Lee, KunHyuk
    Feng, Xue
    Huang, Yonggang
    Rogers, John A.
    [J]. NATURE, 2019, 575 (7783) : 473 - +
  • [60] Augmented Reality and Virtual Reality Displays: Perspectives and Challenges
    Zhan, Tao
    Yin, Kun
    Xiong, Jianghao
    He, Ziqian
    Wu, Shin-Tson
    [J]. ISCIENCE, 2020, 23 (08)