A case study in phenomenology of visual experience with retinal prosthesis versus visual-to-auditory sensory substitution

被引:6
|
作者
Maimon, Amber [1 ,2 ]
Yizhar, Or [1 ,3 ,5 ,6 ]
Buchs, Galit [1 ,3 ]
Heimler, Benedetta [4 ]
Amedi, Amir [1 ,2 ]
机构
[1] Reichman Univ, Baruch Ivcher Inst Brain Cognit & Technol, Baruch Ivcher Sch Psychol, Herzliyya, Israel
[2] Reichman Univ, Ruth & Meir Rosenthal Brain Imaging Ctr, Herzliyya, Israel
[3] Hebrew Univ Jerusalem, Dept Cognit & Brain Sci, Jerusalem, Israel
[4] Sheba Med Ctr, Ctr Adv Technol Rehabil CATR, Ramat Gan, Israel
[5] Max Planck Inst Human Dev, Res Grp Adapt Memory & Decis Making, Berlin, Germany
[6] Max Planck Inst Human Dev, Max Planck Dahlem Campus Cognit MPDCC, Berlin, Germany
基金
欧洲研究理事会;
关键词
Sensory substitution; Visual prosthesis; Blindness; Vision; Visual experience; Vision restoration; CROSS-MODAL PLASTICITY; OCCIPITAL CORTEX; BLINDNESS; BRAIN; PERCEPTION; ORGANIZATION; SYSTEM; SENSES; FORM; US;
D O I
10.1016/j.neuropsychologia.2022.108305
中图分类号
B84 [心理学]; C [社会科学总论]; Q98 [人类学];
学科分类号
03 ; 0303 ; 030303 ; 04 ; 0402 ;
摘要
The phenomenology of the blind has provided an age-old, unparalleled means of exploring the enigmatic link between the brain and mind. This paper delves into the unique phenomenological experience of a man who became blind in adulthood. He subsequently underwent both an Argus II retinal prosthesis implant and training, and extensive training on the EyeMusic visual to auditory sensory substitution device (SSD), thereby becoming the first reported case to date of dual proficiency with both devices. He offers a firsthand account into what he considers the great potential of combining sensory substitution devices with visual prostheses as part of a complete visual restoration protocol. While the Argus II retinal prosthesis alone provided him with immediate visual percepts by way of electrically stimulated phosphenes elicited by the device, the EyeMusic SSD requires extensive training from the onset. Yet following the extensive training program with the EyeMusic sensory substitution device, our subject reports that the sensory substitution device allowed him to experience a richer, more complex perceptual experience, that felt more "second nature" to him, while the Argus II prosthesis (which also requires training) did not allow him to achieve the same levels of automaticity and transparency. Following long-term use of the EyeMusic SSD, our subject reported that visual percepts representing mainly, but not limited to, colors portrayed by the EyeMusic SSD are elicited in association with auditory stimuli, indicating the acquisition of a high level of automaticity. Finally, the case study indicates an additive benefit to the combination of both devices on the user's subjective phenomenological visual experience.
引用
收藏
页数:10
相关论文
共 43 条
  • [21] How Much Spatial Information Is Lost in the Sensory Substitution Process? Comparing Visual, Tactile, and Auditory Approaches
    Richardson, Michael
    Thar, Jan
    Alvarez, James
    Borchers, Jan
    Ward, Jamie
    Hamilton-Fletcher, Giles
    PERCEPTION, 2019, 48 (11) : 1079 - 1103
  • [22] Sensory Substitution: The Spatial Updating of Auditory Scenes "Mimics" the Spatial Updating of Visual Scenes
    Pasqualotto, Achille
    Esenkaya, Tayfun
    FRONTIERS IN BEHAVIORAL NEUROSCIENCE, 2016, 10
  • [23] Deep Learning-Based Optimization of Visual-Auditory Sensory Substitution
    Kim, Mooseop
    Park, Yunkyung
    Moon, Kyeongdeok
    Jeong, Chi Yoon
    IEEE ACCESS, 2023, 11 : 14169 - 14180
  • [24] Properties of imagined experience across visual, auditory, and other sensory modalities
    Sulfaro, Alexander A.
    Robinson, Amanda K.
    Carlson, Thomas A.
    CONSCIOUSNESS AND COGNITION, 2024, 117
  • [25] Hearing Shapes: Event-related Potentials Reveal the Time Course of Auditory-Visual Sensory Substitution
    Graulty, Christian
    Papaioannou, Orestis
    Bauer, Phoebe
    Pitts, Michael A.
    Canseco-Gonzalez, Enriqueta
    JOURNAL OF COGNITIVE NEUROSCIENCE, 2018, 30 (04) : 498 - 513
  • [26] A case-control study of visual, auditory and audio-visual sensory interactions in children with autism spectrum disorder
    Norcia, Anthony M.
    Lee, Azalea
    Meredith, Wesley J.
    Kohler, Peter J.
    Pei, Francesca
    Ghassan, Stephanie A.
    Libove, Robin A.
    Phillips, Jennifer M.
    Hardan, Antonio Y.
    JOURNAL OF VISION, 2021, 21 (04):
  • [27] Blindness enhances auditory obstacle circumvention: Assessing echolocation, sensory substitution, and visual-based navigation
    Kolarik, Andrew J.
    Scarfe, Amy C.
    Moore, Brian C. J.
    Pardhan, Shahina
    PLOS ONE, 2017, 12 (04):
  • [28] The sound of reading: Color-to-timbre substitution boosts reading performance via OVAL, a novel auditory orthography optimized for visual-to-auditory mapping
    Arbel, Roni
    Heimler, Benedetta
    Amedi, Amir
    PLOS ONE, 2020, 15 (11):
  • [29] Impact of Device and Environment on Visual-Auditory Sensory Substitution: A Comprehensive Behavioral Analysis Using the vOICe Algorithm
    Kim, Mooseop
    Park, Yunkyung
    Moon, Kyeongdeok
    Jeong, Chi Yoon
    IEEE ACCESS, 2024, 12 : 90501 - 90510
  • [30] Multisensory perception in Argus II retinal prosthesis patients: Leveraging auditory-visual mappings to enhance prosthesis outcomes
    Stiles, Noelle R. B.
    Patel, Vivek R.
    Weiland, James D.
    VISION RESEARCH, 2021, 182 : 58 - 68