Towards Visual-Tactile Integration of Shoulder and Hand Using Immersive Virtual Reality

被引:1
|
作者
Cardoso, Lucas R. L. [1 ]
Melendez-Calderon, Alejandro [1 ,2 ,3 ]
Bochkezanian, Vanesa [4 ]
Forner-Cordero, Arturo [5 ]
Bo, Antonio P. L. [1 ]
机构
[1] Univ Queensland, Sch Informat Technol & Elect Engn, Brisbane, Qld, Australia
[2] Univ Queensland, Sch Hlth & Rehabil Sci, Brisbane, Qld, Australia
[3] Metro North Hlth, Jamieson Trauma Inst, Brisbane, Qld, Australia
[4] Cent Queensland Univ, Sch Hlth Med & Appl Sci, Coll Hlth Sci, Rockhampton, Qld, Australia
[5] Univ Sao Paulo, Biomechatron Lab, Escola Politecn, Sao Paulo, Brazil
来源
2023 45TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE & BIOLOGY SOCIETY, EMBC | 2023年
关键词
D O I
10.1109/EMBC40787.2023.10340578
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Shoulder-controlled hand neuroprostheses are wearable devices designed to assist hand function in people with cervical spinal cord injury (SCI). They use preserved shoulder movements to control artificial actuators. Due to the concurrent afferent (i.e., shoulder proprioception) and visual (i.e., hand response) feedback, these wearables may affect the user's body somatosensory representation. To investigate this effect, we propose an experimental paradigm that uses immersive virtual reality (VR) environment to emulate the use of a shoulder-controlled hand neuroprostheses and an adapted version of a visual-tactile integration task (i.e., Crossmodal Congruency Task) as an assessment tool. Data from seven non-disabled participants validates the experimental setup, with preliminary statistical analysis revealing no significant difference across the means of VR and visual-tactile integration tasks. The results serve as a proof-of-concept for the proposed paradigm, paving the way for further research with improvements in the experimental design and a larger sample size.
引用
收藏
页数:4
相关论文
共 50 条
  • [1] Altering Time Perception in Virtual Reality Through Multimodal Visual-Tactile Kappa Effect
    De-Pra, Yuri
    Catrambone, Vincenzo
    van-Wassenhove, Virginie
    Moscatelli, Alessandro
    Valenza, Gaetano
    Bianchi, Matteo
    IEEE TRANSACTIONS ON HAPTICS, 2023, 16 (04) : 518 - 523
  • [2] Vision of a pictorial hand modulates visual-tactile interactions
    Yuka Igarashi
    Norimichi Kitagawa
    Shigeru Ichihara
    Cognitive, Affective, & Behavioral Neuroscience, 2004, 4 : 182 - 192
  • [3] Rescaling perceptual hand maps by visual-tactile recalibration
    Fuchs, Xaver
    Heed, Tobias
    EUROPEAN JOURNAL OF NEUROSCIENCE, 2025, 61 (01)
  • [4] Vision of a pictorial hand modulates visual-tactile interactions
    Igarashi, Yuka
    Kitagawa, Norimichi
    Ichihara, Shigeru
    COGNITIVE AFFECTIVE & BEHAVIORAL NEUROSCIENCE, 2004, 4 (02) : 182 - 192
  • [5] Visual-Tactile Sensing for In-Hand Object Reconstruction
    Xu, Wenqiang
    Yu, Zhenjun
    Xue, Han
    Ye, Ruolin
    Yao, Siqiong
    Lu, Cewu
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 8803 - 8812
  • [6] The Hand Prehensile Movement Modified by Visual Illusion in Immersive Virtual Reality
    Choi, Daniel
    Jeong, Taeyeong
    Kim, Jihun
    Kim, Jaehyo
    2021 IEEE 3RD GLOBAL CONFERENCE ON LIFE SCIENCES AND TECHNOLOGIES (IEEE LIFETECH 2021), 2021, : 185 - 186
  • [7] Visual-tactile multisensory integration in primate parietal operculum
    Hihara, Sayaka
    Iriki, Atsushi
    Taoka, Miki
    Tanaka, Michio
    JOURNAL OF PHYSIOLOGICAL SCIENCES, 2013, 63 : S253 - S253
  • [8] A mixed reality framework for microsurgery simulation with visual-tactile perception
    Xiang, Nan
    Liang, Hai-Ning
    Yu, Lingyun
    Yang, Xiaosong
    Zhang, Jian J.
    VISUAL COMPUTER, 2023, 39 (08): : 3661 - 3673
  • [9] A mixed reality framework for microsurgery simulation with visual-tactile perception
    Nan Xiang
    Hai-Ning Liang
    Lingyun Yu
    Xiaosong Yang
    Jian J. Zhang
    The Visual Computer, 2023, 39 : 3661 - 3673
  • [10] Using Immersive Virtual Reality to Examine How Visual and Tactile Cues Drive the Material-Weight Illusion
    Naylor, Caitlin Elisabeth
    Proulx, Michael J.
    Buckingham, Gavin
    ATTENTION PERCEPTION & PSYCHOPHYSICS, 2022, 84 (02) : 509 - 518