View-symmetric representations of faces in human and artificial neural networks

被引:0
|
作者
Zhu, Xun [1 ]
Watson, David M. [1 ]
Rogers, Daniel [1 ]
Andrews, Timothy J. [1 ]
机构
[1] Univ York, Dept Psychol, York YO10 4PF, England
关键词
Face; Symmetry; Viewpoint; DCNN; fMRI; RECOGNITION; VIEWPOINT;
D O I
10.1016/j.neuropsychologia.2024.109061
中图分类号
B84 [心理学]; C [社会科学总论]; Q98 [人类学];
学科分类号
03 ; 0303 ; 030303 ; 04 ; 0402 ;
摘要
View symmetry has been suggested to be an important intermediate representation between view-specific and view-invariant representations of faces in the human brain. Here, we compared view-symmetry in humans and a deep convolutional neural network (DCNN) trained to recognise faces. First, we compared the output of the DCNN to head rotations in yaw (left-right), pitch (up-down) and roll (in-plane rotation). For yaw, an initial viewspecific representation was evident in the convolutional layers, but a view-symmetric representation emerged in the fully-connected layers. Consistent with a role in the recognition of faces, we found that view-symmetric responses to yaw were greater for same identity compared to different identity faces. In contrast, we did not find a similar transition from view-specific to view-symmetric representations in the DCNN for either pitch or roll. These findings suggest that view-symmetry emerges when opposite rotations of the head lead to mirror images. Next, we compared the view-symmetric patterns of response to yaw in the DCNN with corresponding behavioural and neural responses in humans. We found that responses in the fully-connected layers of the DCNN correlated with judgements of perceptual similarity and with the responses of higher visual regions. These findings suggest that view-symmetric representations may be computationally efficient way to represent faces in humans and artificial neural networks for the recognition of identity.
引用
收藏
页数:11
相关论文
共 50 条
  • [1] The emergence of view-symmetric neural responses to familiar and unfamiliar faces
    Rogers, Daniel
    Andrews, Timothy J.
    NEUROPSYCHOLOGIA, 2022, 172
  • [2] Convergent Representations of Computer Programs in Human and Artificial Neural Networks
    Srikant, Shashank
    Lipkin, Benjamin
    Ivanova, Anna A.
    Fedorenko, Evelina
    O'Reilly, Una-May
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
  • [3] Compositional generalization through abstract representations in human and artificial neural networks
    Ito, Takuya
    Klinger, Tim
    Schultz, Douglas H.
    Murray, John D.
    Cole, Michael W.
    Rigotti, Mattia
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
  • [4] Representations and generalization in artificial and brain neural networks
    Li, Qianyi
    Sorscher, Ben
    Sompolinsky, Haim
    PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2024, 121 (27)
  • [5] Learning flat representations with artificial neural networks
    Vlad Constantinescu
    Costin Chiru
    Tudor Boloni
    Adina Florea
    Robi Tacutu
    Applied Intelligence, 2021, 51 : 2456 - 2470
  • [6] Learning flat representations with artificial neural networks
    Constantinescu, Vlad
    Chiru, Costin
    Boloni, Tudor
    Florea, Adina
    Tacutu, Robi
    APPLIED INTELLIGENCE, 2021, 51 (04) : 2456 - 2470
  • [7] Linking artificial and human neural representations of language
    Gauthier, Jon
    Levy, Roger P.
    2019 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING AND THE 9TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING (EMNLP-IJCNLP 2019): PROCEEDINGS OF THE CONFERENCE, 2019, : 529 - 539
  • [8] Statistical physics and representations in real and artificial neural networks
    Cocco, S.
    Monasson, R.
    Posani, L.
    Rosay, S.
    Tubiana, J.
    PHYSICA A-STATISTICAL MECHANICS AND ITS APPLICATIONS, 2018, 504 : 45 - 76
  • [9] Revealing interpretable object representations from human visual cortex and artificial neural networks
    Hebart, Martin
    2023 11TH INTERNATIONAL WINTER CONFERENCE ON BRAIN-COMPUTER INTERFACE, BCI, 2023,
  • [10] Convergent Temperature Representations in Artificial and Biological Neural Networks
    Haesemeyer, Martin
    Schier, Alexander F.
    Engert, Florian
    NEURON, 2019, 103 (06) : 1123 - +