A case study in phenomenology of visual experience with retinal prosthesis versus visual-to-auditory sensory substitution

被引:6
|
作者
Maimon, Amber [1 ,2 ]
Yizhar, Or [1 ,3 ,5 ,6 ]
Buchs, Galit [1 ,3 ]
Heimler, Benedetta [4 ]
Amedi, Amir [1 ,2 ]
机构
[1] Reichman Univ, Baruch Ivcher Inst Brain Cognit & Technol, Baruch Ivcher Sch Psychol, Herzliyya, Israel
[2] Reichman Univ, Ruth & Meir Rosenthal Brain Imaging Ctr, Herzliyya, Israel
[3] Hebrew Univ Jerusalem, Dept Cognit & Brain Sci, Jerusalem, Israel
[4] Sheba Med Ctr, Ctr Adv Technol Rehabil CATR, Ramat Gan, Israel
[5] Max Planck Inst Human Dev, Res Grp Adapt Memory & Decis Making, Berlin, Germany
[6] Max Planck Inst Human Dev, Max Planck Dahlem Campus Cognit MPDCC, Berlin, Germany
基金
欧洲研究理事会;
关键词
Sensory substitution; Visual prosthesis; Blindness; Vision; Visual experience; Vision restoration; CROSS-MODAL PLASTICITY; OCCIPITAL CORTEX; BLINDNESS; BRAIN; PERCEPTION; ORGANIZATION; SYSTEM; SENSES; FORM; US;
D O I
10.1016/j.neuropsychologia.2022.108305
中图分类号
B84 [心理学]; C [社会科学总论]; Q98 [人类学];
学科分类号
03 ; 0303 ; 030303 ; 04 ; 0402 ;
摘要
The phenomenology of the blind has provided an age-old, unparalleled means of exploring the enigmatic link between the brain and mind. This paper delves into the unique phenomenological experience of a man who became blind in adulthood. He subsequently underwent both an Argus II retinal prosthesis implant and training, and extensive training on the EyeMusic visual to auditory sensory substitution device (SSD), thereby becoming the first reported case to date of dual proficiency with both devices. He offers a firsthand account into what he considers the great potential of combining sensory substitution devices with visual prostheses as part of a complete visual restoration protocol. While the Argus II retinal prosthesis alone provided him with immediate visual percepts by way of electrically stimulated phosphenes elicited by the device, the EyeMusic SSD requires extensive training from the onset. Yet following the extensive training program with the EyeMusic sensory substitution device, our subject reports that the sensory substitution device allowed him to experience a richer, more complex perceptual experience, that felt more "second nature" to him, while the Argus II prosthesis (which also requires training) did not allow him to achieve the same levels of automaticity and transparency. Following long-term use of the EyeMusic SSD, our subject reported that visual percepts representing mainly, but not limited to, colors portrayed by the EyeMusic SSD are elicited in association with auditory stimuli, indicating the acquisition of a high level of automaticity. Finally, the case study indicates an additive benefit to the combination of both devices on the user's subjective phenomenological visual experience.
引用
收藏
页数:10
相关论文
共 43 条
  • [1] The evolution of a visual-to-auditory sensory substitution device using interactive genetic algorithms
    Wright, Thomas
    Ward, Jamie
    QUARTERLY JOURNAL OF EXPERIMENTAL PSYCHOLOGY, 2013, 66 (08): : 1620 - 1638
  • [2] 'Visual' Acuity of the Congenitally Blind Using Visual-to-Auditory Sensory Substitution
    Striem-Amit, Ella
    Guendelman, Miriam
    Amedi, Amir
    PLOS ONE, 2012, 7 (03):
  • [3] Fast, accurate reaching movements with a visual-to-auditory sensory substitution device
    Levy-Tzedek, S.
    Hanassy, S.
    Abboud, S.
    Maidenbaum, S.
    Amedi, A.
    RESTORATIVE NEUROLOGY AND NEUROSCIENCE, 2012, 30 (04) : 313 - 323
  • [4] Visual-to-auditory sensory substitution alters language asymmetry in both sighted novices and experienced visually impaired users
    Proulx, Michael J.
    Brown, David J.
    Lloyd-Esenkaya, Tayfun
    Leveson, Jack Barnett
    Todorov, Orlin S.
    Watson, Samuel H.
    de Sousa, Alexandra A.
    APPLIED ERGONOMICS, 2020, 85
  • [5] Navigation aid for blind persons by visual-to-auditory sensory substitution: A pilot study
    Neugebauer, Alexander
    Rifai, Katharina
    Getzlaff, Mathias
    Wahl, Siegfried
    PLOS ONE, 2020, 15 (08):
  • [6] Seeing with sound? Exploring different characteristics of a visual-to-auditory sensory substitution device
    Brown, David
    Macpherson, Tom
    Ward, Jamie
    PERCEPTION, 2011, 40 (09) : 1120 - 1135
  • [7] Face shape processing via visual-to-auditory sensory substitution activates regions within the face processing networks in the absence of visual experience
    Arbel, Roni
    Heimler, Benedetta
    Amedi, Amir
    FRONTIERS IN NEUROSCIENCE, 2022, 16
  • [8] EyeMusic: Introducing a "visual" colorful experience for the blind using auditory sensory substitution
    Abboud, Sami
    Hanassy, Shlomi
    Levy-Tzedek, Shelly
    Maidenbaum, Shachar
    Amedi, Amir
    RESTORATIVE NEUROLOGY AND NEUROSCIENCE, 2014, 32 (02) : 247 - 257
  • [9] Shape detection beyond the visual field using a visual-to-auditory sensory augmentation device
    Shvadron, Shira
    Snir, Adi
    Maimon, Amber
    Yizhar, Or
    Harel, Sapir
    Poradosu, Keinan
    Amedi, Amir
    FRONTIERS IN HUMAN NEUROSCIENCE, 2023, 17
  • [10] Flexibility and Stability in Sensory Processing Revealed Using Visual-to-Auditory Sensory Substitution
    Hertz, Uri
    Amedi, Amir
    CEREBRAL CORTEX, 2015, 25 (08) : 2049 - 2064