Integrating unsupervised and reinforcement learning in human categorical perception: A computational model

被引:5
作者
Granato, Giovanni [1 ,2 ]
Cartoni, Emilio [1 ]
Da Rold, Federico [3 ]
Mattera, Andrea [1 ]
Baldassarre, Gianluca [1 ]
机构
[1] Natl Res Council Italy, Inst Cognit Sci & Technol, Lab Computat Embodied Neurosci, Rome, Italy
[2] Univ Plymouth, Sch Comp Elect & Math, Plymouth, Devon, England
[3] Natl Res Council Italy, Inst Cognit Sci & Technol, Body Act Language Lab, Rome, Italy
来源
PLOS ONE | 2022年 / 17卷 / 05期
基金
欧盟地平线“2020”;
关键词
VISUAL CATEGORIZATION; BASAL GANGLIA; REPRESENTATIONS; CORTEX; DISCRIMINATION; INFORMATION; SELECTIVITY; COGNITION; DOPAMINE; SIGNALS;
D O I
10.1371/journal.pone.0267838
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Categorical perception identifies a tuning of human perceptual systems that can occur during the execution of a categorisation task. Despite the fact that experimental studies and computational models suggest that this tuning is influenced by task-independent effects (e.g., based on Hebbian and unsupervised learning, UL) and task-dependent effects (e.g., based on reward signals and reinforcement learning, RL), no model studies the UL/RL interaction during the emergence of categorical perception. Here we have investigated the effects of this interaction, proposing a system-level neuro-inspired computational architecture in which a perceptual component integrates UL and RL processes. The model has been tested with a categorisation task and the results show that a balanced mix of unsupervised and reinforcement learning leads to the emergence of a suitable categorical perception and the best performance in the task. Indeed, an excessive unsupervised learning contribution tends to not identify task-relevant features while an excessive reinforcement learning contribution tends to initially learn slowly and then to reach sub-optimal performance. These results are consistent with the experimental evidence regarding categorical activations of extrastriate cortices in healthy conditions. Finally, the results produced by the two extreme cases of our model can explain the existence of several factors that may lead to sensory alterations in autistic people.
引用
收藏
页数:32
相关论文
共 129 条
  • [41] Embodied cognition
    Foglia, Lucia
    Wilson, Robert A.
    [J]. WILEY INTERDISCIPLINARY REVIEWS-COGNITIVE SCIENCE, 2013, 4 (03) : 319 - 325
  • [42] Category Learning Stretches Neural Representations in Visual Cortex
    Folstein, Jonathan R.
    Palmeri, Thomas J.
    Van Gulick, Ana E.
    Gauthier, Isabel
    [J]. CURRENT DIRECTIONS IN PSYCHOLOGICAL SCIENCE, 2015, 24 (01) : 17 - 23
  • [43] Frith C, 2003, NOVART FDN SYMP, V251, P149
  • [44] Froudist-Walsh S., 2020, BIORXIV
  • [45] The development of voicing categories: A quantitative review of over 40 years of infant speech perception research
    Galle, Marcus E.
    McMurray, Bob
    [J]. PSYCHONOMIC BULLETIN & REVIEW, 2014, 21 (04) : 884 - 906
  • [46] From Hyposociability to Hypersociability-The Effects of PSD-95 Deficiency on the Dysfunctional Development of Social Behavior
    Gao, Wen-Jun
    Mack, Nancy R.
    [J]. FRONTIERS IN BEHAVIORAL NEUROSCIENCE, 2021, 15
  • [47] Perceptual learning
    Gold, Joshua I.
    Watanabe, Takeo
    [J]. CURRENT BIOLOGY, 2010, 20 (02) : R46 - R48
  • [48] Categorical perception
    Goldstone, Robert L.
    Hendrickson, Andrew T.
    [J]. WILEY INTERDISCIPLINARY REVIEWS-COGNITIVE SCIENCE, 2010, 1 (01) : 69 - 78
  • [49] Goodfellow I, 2016, ADAPT COMPUT MACH LE, P1
  • [50] Internal manipulation of perceptual representations in human flexible cognition: A computational model
    Granato, Giovanni
    Baldassarre, Gianluca
    [J]. NEURAL NETWORKS, 2021, 143 : 572 - 594