A case study in phenomenology of visual experience with retinal prosthesis versus visual-to-auditory sensory substitution

被引:6
|
作者
Maimon, Amber [1 ,2 ]
Yizhar, Or [1 ,3 ,5 ,6 ]
Buchs, Galit [1 ,3 ]
Heimler, Benedetta [4 ]
Amedi, Amir [1 ,2 ]
机构
[1] Reichman Univ, Baruch Ivcher Inst Brain Cognit & Technol, Baruch Ivcher Sch Psychol, Herzliyya, Israel
[2] Reichman Univ, Ruth & Meir Rosenthal Brain Imaging Ctr, Herzliyya, Israel
[3] Hebrew Univ Jerusalem, Dept Cognit & Brain Sci, Jerusalem, Israel
[4] Sheba Med Ctr, Ctr Adv Technol Rehabil CATR, Ramat Gan, Israel
[5] Max Planck Inst Human Dev, Res Grp Adapt Memory & Decis Making, Berlin, Germany
[6] Max Planck Inst Human Dev, Max Planck Dahlem Campus Cognit MPDCC, Berlin, Germany
基金
欧洲研究理事会;
关键词
Sensory substitution; Visual prosthesis; Blindness; Vision; Visual experience; Vision restoration; CROSS-MODAL PLASTICITY; OCCIPITAL CORTEX; BLINDNESS; BRAIN; PERCEPTION; ORGANIZATION; SYSTEM; SENSES; FORM; US;
D O I
10.1016/j.neuropsychologia.2022.108305
中图分类号
B84 [心理学]; C [社会科学总论]; Q98 [人类学];
学科分类号
03 ; 0303 ; 030303 ; 04 ; 0402 ;
摘要
The phenomenology of the blind has provided an age-old, unparalleled means of exploring the enigmatic link between the brain and mind. This paper delves into the unique phenomenological experience of a man who became blind in adulthood. He subsequently underwent both an Argus II retinal prosthesis implant and training, and extensive training on the EyeMusic visual to auditory sensory substitution device (SSD), thereby becoming the first reported case to date of dual proficiency with both devices. He offers a firsthand account into what he considers the great potential of combining sensory substitution devices with visual prostheses as part of a complete visual restoration protocol. While the Argus II retinal prosthesis alone provided him with immediate visual percepts by way of electrically stimulated phosphenes elicited by the device, the EyeMusic SSD requires extensive training from the onset. Yet following the extensive training program with the EyeMusic sensory substitution device, our subject reports that the sensory substitution device allowed him to experience a richer, more complex perceptual experience, that felt more "second nature" to him, while the Argus II prosthesis (which also requires training) did not allow him to achieve the same levels of automaticity and transparency. Following long-term use of the EyeMusic SSD, our subject reported that visual percepts representing mainly, but not limited to, colors portrayed by the EyeMusic SSD are elicited in association with auditory stimuli, indicating the acquisition of a high level of automaticity. Finally, the case study indicates an additive benefit to the combination of both devices on the user's subjective phenomenological visual experience.
引用
收藏
页数:10
相关论文
共 43 条
  • [31] A Study of Multi-Sensory Experience and Color Recognition in Visual Arts Appreciation of People with Visual Impairment
    Cho, Jun Dong
    ELECTRONICS, 2021, 10 (04) : 1 - 37
  • [32] Visual Rehabilitation after Retinal Prosthesis Implantation: An 18-month Case Report, From Candidate Selection to Follow-Up
    Carignan, Mathieu
    Courchesne, Marie
    Cantin, Sylvie
    Moore, Vincent
    Poncet, Frederique
    JOURNAL OF VISUAL IMPAIRMENT & BLINDNESS, 2022, 116 (02) : 167 - 182
  • [33] Antipsychotic agents deteriorate brain and retinal function in schizophrenia patients with combined auditory and visual hallucinations: A pilot study and secondary follow-up study
    Zhuo, Chuanjun
    Xiao, Bo
    Chen, Ce
    Jiang, Deguo
    Li, Gongying
    Ma, Xiaoyan
    Li, Ranli
    Wang, Lina
    Xu, Yong
    Zhou, Chunhua
    Lin, Xiaodong
    BRAIN AND BEHAVIOR, 2020, 10 (06):
  • [34] Composing in the scanner: A functional magnetic resonance imaging single case study on visual and auditory imagery
    Izadifar, Morteza
    Yang, Taoxi
    Paolini, Marco
    Formuli, Arusu
    Bao, Yan
    PSYCH JOURNAL, 2022, 11 (05) : 684 - 690
  • [35] Sensory cue integration of visual and vestibular stimuli: a case study for 4D rides
    Lee, Jiwan
    Han, Sung H.
    Choi, Seungmoon
    VIRTUAL REALITY, 2023, 27 (03) : 1671 - 1683
  • [36] Pilot study of the emotion cognition based on visual experience: A case study of roadside buildings in the Orio-Hibikino area
    Perwira, Satrio Agung
    Dewancker, Bart
    Herjuno, Dimas
    FRONTIERS OF ARCHITECTURAL RESEARCH, 2024, 13 (05) : 1113 - 1126
  • [37] Relating material experience to technical parameters: A case study on visual and tactile warmth perception of indoor wall materials
    Wastiels, Lisa
    Schifferstein, Hendrik N. J.
    Heylighen, Ann
    Wouters, Ine
    BUILDING AND ENVIRONMENT, 2012, 49 : 359 - 367
  • [38] Abberant inverted U-shaped brain pattern and trait-related retinal impairment in schizophrenia patients with combined auditory and visual hallucinations: a pilot study
    Zhuo, Chuanjun
    Xiao, Bo
    Chen, Ce
    Jiang, Deguo
    Li, Gongying
    Ma, Xiaoyan
    Li, Ranli
    Wang, Lina
    Xu, Yong
    Zhou, Chunhua
    Lin, Xiaodong
    BRAIN IMAGING AND BEHAVIOR, 2021, 15 (02) : 738 - 747
  • [39] A new framework for dynamic visual landscape quality evaluation of greenways based on perceived sensory dimensions: A case study of Chengdu urban greenway
    Qi, Zhao
    Jin, Xiaobin
    Liang, Xinyuan
    Han, Bo
    Zhou, Yinkang
    JOURNAL OF ENVIRONMENTAL MANAGEMENT, 2024, 370
  • [40] Primary degeneration of oculomotor, motor, and somatosensory systems and auditory and visual pathways in spinocerebellar ataxia type 7: A clinicopathological study in a Japanese autopsy case
    Ouchi, Haruka
    Ishiguro, Hideaki
    Shibano, Ken
    Hara, Kenju
    Sugawara, Masashiro
    Enomoto, Katsuhiko
    Miyata, Hajime
    NEUROPATHOLOGY, 2023, 43 (02) : 164 - 175