Mid-level visual features underlie the high-level categorical organization of the ventral stream

被引:136
作者
Long, Bria [1 ,2 ]
Yu, Chen-Ping [1 ,3 ]
Konkle, Talia [1 ]
机构
[1] Harvard Univ, Dept Psychol, 33 Kirkland St, Cambridge, MA 02138 USA
[2] Stanford Univ, Dept Psychol, Stanford, CA 94305 USA
[3] Phiar Technol Inc, Palo Alto, CA 94303 USA
关键词
ventral stream organization; mid-level features; object recognition; fMRI; deep neural networks; FUSIFORM FACE AREA; NEURAL REPRESENTATIONS; CONGENITALLY BLIND; TEMPORAL CORTEX; OBJECT CATEGORY; SHAPE; SELECTIVITY; SIZE; PERCEPTION; SIMILARITY;
D O I
10.1073/pnas.1719616115
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Human object-selective cortex shows a large-scale organization characterized by the high-level properties of both animacy and object size. To what extent are these neural responses explained by primitive perceptual features that distinguish animals from objects and big objects from small objects? To address this question, we used a texture synthesis algorithm to create a class of stimuli-texforms-which preserve some mid-level texture and form information from objects while rendering them unrecognizable. We found that unrecognizable texforms were sufficient to elicit the large-scale organizations of object-selective cortex along the entire ventral pathway. Further, the structure in the neural patterns elicited by texforms was well predicted by curvature features and by intermediate layers of a deep convolutional neural network, supporting the mid-level nature of the representations. These results provide clear evidence that a substantial portion of ventral stream organization can be accounted for by coarse texture and form information without requiring explicit recognition of intact objects.
引用
收藏
页码:E9015 / E9024
页数:10
相关论文
共 50 条
  • [31] OCCLUSION BOUNDARY DETECTION BASED ON MID-LEVEL FIGURE/GROUND ASSIGNMENT FEATURES
    Murasaki, Kazuhiko
    Sudo, Kyoko
    Taniguchi, Yukinobu
    2014 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2014, : 4707 - 4711
  • [32] High-level aftereffects reveal the role of statistical features in visual shape encoding
    Morgenstern, Yaniv
    Storrs, Katherine R.
    Schmidt, Filipp
    Hartmann, Frieder
    Tiedemann, Henning
    Wagemans, Johan
    Fleming, Roland W.
    CURRENT BIOLOGY, 2024, 34 (05) : 1098 - 1106.e5
  • [33] A data-driven approach to stimulus selection reveals an image-based representation of objects in high-level visual areas
    Coggan, David D.
    Giannakopoulou, Afrodite
    Ali, Sanah
    Goz, Burcu
    Watson, David M.
    Hartley, Tom
    Baker, Daniel H.
    Andrews, Timothy J.
    HUMAN BRAIN MAPPING, 2019, 40 (16) : 4716 - 4731
  • [34] Selectivity for low-level features of objects in the human ventral stream
    Andrews, Timothy J.
    Clarke, Alex
    Pell, Philip
    Hartley, Tom
    NEUROIMAGE, 2010, 49 (01) : 703 - 711
  • [35] POLSAR IMAGE CLASSIFICATION BASED ON AN IMPROVED BOW MODEL WITH MID-LEVEL SEMANTIC FEATURES
    Zou, Bin
    Zhang, Yu
    Zhang, Lamei
    2019 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2019), 2019, : 3768 - 3771
  • [36] Comparison of mid-level feature coding approaches and pooling strategies in visual concept detection
    Koniusz, Piotr
    Yan, Fei
    Mikolajczyk, Krystian
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2013, 117 (05) : 479 - 492
  • [37] High-level visual prediction errors in early visual cortex
    Richter, David
    Kietzmann, Tim C.
    de Lange, Floris P.
    PLOS BIOLOGY, 2024, 22 (11)
  • [38] Altered topological organization of high-level visual networks in Alzheimer's disease and mild cognitive impairment patients
    Deng, Yanjia
    Shi, Lin
    Lei, Yi
    Wang, Defeng
    NEUROSCIENCE LETTERS, 2016, 630 : 147 - 153
  • [39] A connectivity-constrained computational account of topographic organization in primate high-level visual cortex
    Blauch, Nicholas M.
    Behrmann, Marlene
    Plaut, David C.
    PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2022, 119 (03)
  • [40] The development of visual categorization based on high-level cues
    Peykarjou, Stefanie
    Hoehl, Stefanie
    Pauen, Sabina
    CHILD DEVELOPMENT, 2024, 95 (02) : e122 - e138