Mid-level visual features underlie the high-level categorical organization of the ventral stream

被引:136
|
作者
Long, Bria [1 ,2 ]
Yu, Chen-Ping [1 ,3 ]
Konkle, Talia [1 ]
机构
[1] Harvard Univ, Dept Psychol, 33 Kirkland St, Cambridge, MA 02138 USA
[2] Stanford Univ, Dept Psychol, Stanford, CA 94305 USA
[3] Phiar Technol Inc, Palo Alto, CA 94303 USA
关键词
ventral stream organization; mid-level features; object recognition; fMRI; deep neural networks; FUSIFORM FACE AREA; NEURAL REPRESENTATIONS; CONGENITALLY BLIND; TEMPORAL CORTEX; OBJECT CATEGORY; SHAPE; SELECTIVITY; SIZE; PERCEPTION; SIMILARITY;
D O I
10.1073/pnas.1719616115
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Human object-selective cortex shows a large-scale organization characterized by the high-level properties of both animacy and object size. To what extent are these neural responses explained by primitive perceptual features that distinguish animals from objects and big objects from small objects? To address this question, we used a texture synthesis algorithm to create a class of stimuli-texforms-which preserve some mid-level texture and form information from objects while rendering them unrecognizable. We found that unrecognizable texforms were sufficient to elicit the large-scale organizations of object-selective cortex along the entire ventral pathway. Further, the structure in the neural patterns elicited by texforms was well predicted by curvature features and by intermediate layers of a deep convolutional neural network, supporting the mid-level nature of the representations. These results provide clear evidence that a substantial portion of ventral stream organization can be accounted for by coarse texture and form information without requiring explicit recognition of intact objects.
引用
收藏
页码:E9015 / E9024
页数:10
相关论文
共 50 条
  • [21] Mid-Level Perceptual Features Distinguish Objects of Different Real-World Sizes
    Long, Bria
    Konkle, Talia
    Cohen, Michael A.
    Alvarez, George A.
    JOURNAL OF EXPERIMENTAL PSYCHOLOGY-GENERAL, 2016, 145 (01) : 95 - 109
  • [22] EXMOVES: Mid-level Features for Efficient Action Recognition and Video Analysis
    Du Tran
    Lorenzo Torresani
    International Journal of Computer Vision, 2016, 119 : 239 - 253
  • [23] EXMOVES: Mid-level Features for Efficient Action Recognition and Video Analysis
    Du Tran
    Torresani, Lorenzo
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2016, 119 (03) : 239 - 253
  • [24] A Graph-based Saliency Detection Fusing with Mid-level Features
    Wang, Lihua
    Wang, Zeliang
    PROCEEDINGS OF 2018 5TH IEEE INTERNATIONAL CONFERENCE ON CLOUD COMPUTING AND INTELLIGENCE SYSTEMS (CCIS), 2018, : 925 - 930
  • [25] Mid-level features and spatio-temporal context for activity recognition
    Yuan, Fei
    Xia, Gui-Song
    Sahbi, Hichem
    Prinet, Veronique
    PATTERN RECOGNITION, 2012, 45 (12) : 4182 - 4191
  • [26] High-level properties and visual experience
    Fish, William
    PHILOSOPHICAL STUDIES, 2013, 162 (01) : 43 - 55
  • [27] Category selectivity for animals and man-made objects: Beyond low- and mid-level visual features
    He, Chenxi
    Cheung, Olivia S.
    JOURNAL OF VISION, 2019, 19 (12): : 1 - 14
  • [28] Semantic Classification of High-Resolution Remote-Sensing Images Based on Mid-level Features
    Zhang, Junping
    Li, Tong
    Lu, Xiaochen
    Cheng, Zhen
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2016, 9 (06) : 2343 - 2353
  • [29] Melodic Contour and Mid-Level Global Features Applied to the Analysis of Flamenco Cantes
    Mora, Joaquin
    Gomez, Francisco
    Gomez, Emilia
    Miguel Diaz-Banez, Jose
    JOURNAL OF NEW MUSIC RESEARCH, 2016, 45 (02) : 145 - 159
  • [30] High-level aftereffects reveal the role of statistical features in visual shape encoding
    Morgenstern, Yaniv
    Storrs, Katherine R.
    Schmidt, Filipp
    Hartmann, Frieder
    Tiedemann, Henning
    Wagemans, Johan
    Fleming, Roland W.
    CURRENT BIOLOGY, 2024, 34 (05) : 1098 - 1106.e5