Localizing 3D motion through the fingertips: Following in the footsteps of elephants

被引:3
作者
Snir, Adi [1 ]
Cies, Katarzyna [1 ,2 ]
Ozdemir, Gizem [1 ]
Vekslar, Rotem [1 ]
Amedi, Amir [1 ]
机构
[1] Reichman Univ, Baruch Ivcher Inst Brain Cognit & Technol, Baruch Ivcher Sch Psychol, HaUniv 8, IL-461010 Herzliyya, Israel
[2] World Hearing Ctr, Inst Physiol & Pathol Hearing, Mokra 17, PL-05830 Kajetany, Nadarzyn, Poland
基金
欧洲研究理事会;
关键词
AUDITORY-CORTEX; TACTILE LOCALIZATION; DISTANCE PERCEPTION; PACINIAN CORPUSCLES; NEURONAL BASES; SOUND; SUBSTITUTION; DEAF; INTEGRATION; FREQUENCY;
D O I
10.1016/j.isci.2024.109820
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Each sense serves a different specific function in spatial perception, and they all form a joint multisensory spatial representation. For instance, hearing enables localization in the entire 3D external space, while touch traditionally only allows localization of objects on the body (i.e., within the peripersonal space alone). We use an in-house touch-motion algorithm (TMA) to evaluate individuals' capability to understand externalized 3D information through touch, a skill that was not acquired during an individual's development or in evolution. Four experiments demonstrate quick learning and high accuracy in localization of motion using vibrotactile inputs on fingertips and successful audio-tactile integration in background noise. Subjective responses in some participants imply spatial experiences through visualization and perception of tactile "moving"sources beyond reach. We discuss our findings with respect to developing new skills in an adult brain, including combining a newly acquired "sense"with an existing one and computation-based brain organization.
引用
收藏
页数:18
相关论文
共 106 条
[1]   EyeMusic: Introducing a "visual" colorful experience for the blind using auditory sensory substitution [J].
Abboud, Sami ;
Hanassy, Shlomi ;
Levy-Tzedek, Shelly ;
Maidenbaum, Shachar ;
Amedi, Amir .
RESTORATIVE NEUROLOGY AND NEUROSCIENCE, 2014, 32 (02) :247-257
[2]   Shape conveyed by visual-to-auditory sensory substitution activates the lateral occipital complex [J].
Amedi, Amir ;
Stern, William M. ;
Camprodon, Joan A. ;
Bermpohl, Felix ;
Merabet, Lotfi ;
Rotman, Stephen ;
Hemond, Christopher ;
Meijer, Peter ;
Pascual-Leone, Alvaro .
NATURE NEUROSCIENCE, 2007, 10 (06) :687-689
[3]   Vibrotactile activation of the auditory cortices in deaf versus hearing adults [J].
Auer, Edward T., Jr. ;
Bernstein, Lynne E. ;
Sungkarat, Witaya ;
Singh, Manbir .
NEUROREPORT, 2007, 18 (07) :645-648
[4]   Learning to perceive with a visuo-auditory substitution system: Localisation and object recognition with 'The vOICe' [J].
Auvray, Malika ;
Hanneton, Sylvain ;
O'Regan, J. Kevin .
PERCEPTION, 2007, 36 (03) :416-430
[5]   VISION SUBSTITUTION BY TACTILE IMAGE PROJECTION [J].
BACH, P ;
COLLINS, CC ;
SAUNDERS, FA ;
WHITE, B ;
SCADDEN, L .
NATURE, 1969, 221 (5184) :963-&
[6]  
Battal C., 2018, Doctoral dissertation
[7]   Touch, sound and vision in human superior temporal sulcus [J].
Beauchamp, Michael S. ;
Yasar, Nafi E. ;
Frye, Richard E. ;
Ro, Tony .
NEUROIMAGE, 2008, 41 (03) :1011-1020
[8]   Auditory Motion Elicits a Visual Motion Aftereffect [J].
Berger, Christopher C. ;
Ehrsson, H. Henrik .
FRONTIERS IN NEUROSCIENCE, 2016, 10
[9]   Rhythm perception is shared between audio and haptics [J].
Bernard, Corentin ;
Monnoyer, Jocelyn ;
Wiertlewski, Michael ;
Ystad, Solvi .
SCIENTIFIC REPORTS, 2022, 12 (01)
[10]   Sound Externalization: A Review of Recent Research [J].
Best, Virginia ;
Baumgartner, Robert ;
Lavandier, Mathieu ;
Majdak, Piotr ;
Kopco, Norbert .
TRENDS IN HEARING, 2020, 24