Augmented tactile-perception and haptic-feedback rings as human-machine interfaces aiming for immersive interactions

被引:296
作者
Sun, Zhongda [1 ,2 ,3 ,4 ,5 ]
Zhu, Minglu [1 ,2 ,3 ,5 ]
Shan, Xuechuan [4 ,6 ]
Lee, Chengkuo [1 ,2 ,3 ,4 ,5 ,7 ]
机构
[1] Natl Univ Singapore, Dept Elect & Comp Engn, 4 Engn Dr 3, Singapore 117583, Singapore
[2] Natl Univ Singapore, Ctr Intelligent Sensors, 4 Engn Dr 3, Singapore 117583, Singapore
[3] Natl Univ Singapore, MEMS, 4 Engn Dr 3, Singapore 117583, Singapore
[4] Natl Univ Singapore, Singapore Inst Mfg Technol & Natl Univ Singapore, 4 Engn Dr 3, Singapore 117583, Singapore
[5] Natl Univ Singapore, Suzhou Res Inst NUSRI, Suzhou Ind Pk, Suzhou 215123, Peoples R China
[6] ASTAR, Singapore Inst Mfg Technol, Printed Intelligent Device Grp, Singapore 637662, Singapore
[7] Natl Univ Singapore, NUS Grad Sch, Integrat Sci & Engn Program ISEP, Singapore 119077, Singapore
关键词
PYROELECTRIC NANOGENERATORS; NANOWIRE HEATER; DEVICES; ROBOT;
D O I
10.1038/s41467-022-32745-8
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Current wearable solutions for Virtual Reality (VR) have limitations of complicated structures and large driven power. Here, the authors report a highly integrated ring consisting of multimodal sensing and feedback units for augmented interactions in metaverse. Advancements of virtual reality technology pave the way for developing wearable devices to enable somatosensory sensation, which can bring more comprehensive perception and feedback in the metaverse-based virtual society. Here, we propose augmented tactile-perception and haptic-feedback rings with multimodal sensing and feedback capabilities. This highly integrated ring consists of triboelectric and pyroelectric sensors for tactile and temperature perception, and vibrators and nichrome heaters for vibro- and thermo-haptic feedback. All these components integrated on the ring can be directly driven by a custom wireless platform of low power consumption for wearable/portable scenarios. With voltage integration processing, high-resolution continuous finger motion tracking is achieved via the triboelectric tactile sensor, which also contributes to superior performance in gesture/object recognition with artificial intelligence analysis. By fusing the multimodal sensing and feedback functions, an interactive metaverse platform with cross-space perception capability is successfully achieved, giving people a face-to-face like immersive virtual social experience.
引用
收藏
页数:13
相关论文
共 70 条
  • [1] Stretchable distributed fiber-optic sensors
    Bai, Hedan
    Li, Shuo
    Barreiros, Jose
    Tu, Yaqi
    Pollock, Clifford R.
    Shepherd, Robert F.
    [J]. SCIENCE, 2020, 370 (6518) : 848 - +
  • [2] Pyroelectric materials and devices for energy harvesting applications
    Bowen, C. R.
    Taylor, J.
    LeBoulbar, E.
    Zabek, D.
    Chauhan, A.
    Vaish, R.
    [J]. ENERGY & ENVIRONMENTAL SCIENCE, 2014, 7 (12) : 3836 - 3856
  • [3] 3D Virtual Worlds and the Metaverse: Current Status and Future Possibilities
    Dionisio, John David N.
    Burns, William G., II
    Gilbert, Richard
    [J]. ACM COMPUTING SURVEYS, 2013, 45 (03)
  • [4] Wearable Triboelectric-Human-Machine Interface (THMI) Using Robust Nanophotonic Readout
    Dong, Bowei
    Yang, Yanqin
    Shi, Qiongfeng
    Xu, Siyu
    Sun, Zhongda
    Zhu, Shiyang
    Zhang, Zixuan
    Kwong, Dim-Lee
    Zhou, Guangya
    Ang, Kah-Wee
    Lee, Chengkuo
    [J]. ACS NANO, 2020, 14 (07) : 8915 - 8930
  • [5] COMPUTER SCIENCE Visionary of virtual reality
    Faisal, Aldo
    [J]. NATURE, 2017, 551 (7680) : 298 - 299
  • [6] Analog Sensing and Computing Systems with Low Power Consumption for Gesture Recognition
    Fan, Tianyi
    Liu, Zheyu
    Luo, Zewei
    Li, Junda
    Tian, Xiyue
    Chen, Yeshen
    Feng, Yuan
    Wang, Chaolun
    Bi, Hengchang
    Li, Xinming
    Qiao, Fei
    Wu, Xing
    [J]. ADVANCED INTELLIGENT SYSTEMS, 2021, 3 (01)
  • [7] Highly Stretchable, Strain Sensing Hydrogel Optical Fibers
    Guo, Jingjing
    Liu, Xinyue
    Jiang, Nan
    Yetisen, Ali K.
    Yuk, Hyunwoo
    Yang, Changxi
    Khademhosseini, Ali
    Zhao, Xuanhe
    Yun, Seok-Hyun
    [J]. ADVANCED MATERIALS, 2016, 28 (46) : 10244 - 10249
  • [8] Artificial Intelligence-Enabled Caregiving Walking Stick Powered by Ultra-Low-Frequency Human Motion
    Guo, Xinge
    He, Tianyiyi
    Zhang, Zixuan
    Luo, Anxin
    Wang, Fei
    Ng, Eldwin J.
    Zhu, Yao
    Liu, Huicong
    Lee, Chengkuo
    [J]. ACS NANO, 2021, 15 (12) : 19054 - 19069
  • [9] Self-powered glove-based intuitive interface for diversified control applications in real/cyber space
    He, Tianyiyi
    Sun, Zhongda
    Shi, Qiongfeng
    Zhu, Minglu
    Anaya, David Vera
    Xu, Mengya
    Chen, Tao
    Yuce, Mehmet Rasit
    Thean, Aaron Voon-Yew
    Lee, Chengkuo
    [J]. NANO ENERGY, 2019, 58 : 641 - 651
  • [10] High Force Density Textile Electrostatic Clutch
    Hinchet, Ronan
    Shea, Herbert
    [J]. ADVANCED MATERIALS TECHNOLOGIES, 2020, 5 (04):