Mid-level visual features underlie the high-level categorical organization of the ventral stream

被引:136
|
作者
Long, Bria [1 ,2 ]
Yu, Chen-Ping [1 ,3 ]
Konkle, Talia [1 ]
机构
[1] Harvard Univ, Dept Psychol, 33 Kirkland St, Cambridge, MA 02138 USA
[2] Stanford Univ, Dept Psychol, Stanford, CA 94305 USA
[3] Phiar Technol Inc, Palo Alto, CA 94303 USA
关键词
ventral stream organization; mid-level features; object recognition; fMRI; deep neural networks; FUSIFORM FACE AREA; NEURAL REPRESENTATIONS; CONGENITALLY BLIND; TEMPORAL CORTEX; OBJECT CATEGORY; SHAPE; SELECTIVITY; SIZE; PERCEPTION; SIMILARITY;
D O I
10.1073/pnas.1719616115
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Human object-selective cortex shows a large-scale organization characterized by the high-level properties of both animacy and object size. To what extent are these neural responses explained by primitive perceptual features that distinguish animals from objects and big objects from small objects? To address this question, we used a texture synthesis algorithm to create a class of stimuli-texforms-which preserve some mid-level texture and form information from objects while rendering them unrecognizable. We found that unrecognizable texforms were sufficient to elicit the large-scale organizations of object-selective cortex along the entire ventral pathway. Further, the structure in the neural patterns elicited by texforms was well predicted by curvature features and by intermediate layers of a deep convolutional neural network, supporting the mid-level nature of the representations. These results provide clear evidence that a substantial portion of ventral stream organization can be accounted for by coarse texture and form information without requiring explicit recognition of intact objects.
引用
收藏
页码:E9015 / E9024
页数:10
相关论文
共 50 条
  • [1] Ensemble representation of animacy could be based on mid-level visual features
    Tiurina, Natalia A.
    Markov, Yuri A.
    ATTENTION PERCEPTION & PSYCHOPHYSICS, 2025, 87 (02) : 415 - 430
  • [2] Organization of high-level visual cortex in human infants
    Deen, Ben
    Richardson, Hilary
    Dilks, Daniel D.
    Takahashi, Atsushi
    Keil, Boris
    Wald, Lawrence L.
    Kanwisher, Nancy
    Saxe, Rebecca
    NATURE COMMUNICATIONS, 2017, 8
  • [3] High-Level Visual Encoding Model Framework with Hierarchical Ventral Stream-Optimized Neural Networks
    Xiao, Wulue
    Li, Jingwei
    Zhang, Chi
    Wang, Linyuan
    Chen, Panpan
    Yu, Ziya
    Tong, Li
    Yan, Bin
    BRAIN SCIENCES, 2022, 12 (08)
  • [4] Object shape and surface properties are jointly encoded in mid-level ventral visual cortex
    Pasupathy, Anitha
    Kim, Taekjun
    Popovkina, Dina V.
    CURRENT OPINION IN NEUROBIOLOGY, 2019, 58 : 199 - 208
  • [5] Contour junctions underlie neural representations of scene categories in high-level human visual cortex
    Choo, Heeyoung
    Walther, Dirk B.
    NEUROIMAGE, 2016, 135 : 32 - 44
  • [6] Unsupervised learning of mid-level visual representations
    Matteucci, Giulio
    Piasini, Eugenio
    Zoccolan, Davide
    CURRENT OPINION IN NEUROBIOLOGY, 2024, 84
  • [7] Mining Mid-level Features for Image Classification
    Basura Fernando
    Elisa Fromont
    Tinne Tuytelaars
    International Journal of Computer Vision, 2014, 108 : 186 - 203
  • [8] Understanding mid-level representations in visual processing
    Peirce, Jonathan W.
    JOURNAL OF VISION, 2015, 15 (07):
  • [9] High-Level Visual Object Representations Are Constrained by Position
    Kravitz, Dwight J.
    Kriegeskorte, Nikolaus
    Baker, Chris I.
    CEREBRAL CORTEX, 2010, 20 (12) : 2916 - 2925
  • [10] Mining Mid-level Features for Image Classification
    Fernando, Basura
    Fromont, Elisa
    Tuytelaars, Tinne
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2014, 108 (03) : 186 - 203