Visual and Semantic Representations Predict Subsequent Memory in Perceptual and Conceptual Memory Tests

被引:33
作者
Davis, Simon W. [1 ,2 ]
Geib, Benjamin R. [1 ]
Wing, Erik A. [1 ]
Wang, Wei-Chun [1 ]
Hovhannisyan, Mariam [2 ]
Monge, Zachary A. [1 ]
Cabeza, Roberto [1 ]
机构
[1] Duke Univ, Ctr Cognit Neurosci, Durham, NC 27708 USA
[2] Duke Univ, Dept Neurol, Sch Med, Durham, NC 27708 USA
关键词
DNNs; episodic memory; object representation; representational similarity analysis; semantic memory; FEATURE-BASED STATISTICS; MULTI-VOXEL PATTERNS; DEEP NEURAL-NETWORKS; LONG-TERM-MEMORY; PREFRONTAL CORTEX; INFORMATION-FLOW; EPISODIC MEMORY; BRAIN; OBJECTS; FMRI;
D O I
10.1093/cercor/bhaa269
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
It is generally assumed that the encoding of a single event generates multiple memory representations, which contribute differently to subsequent episodic memory. We used functional magnetic resonance imaging (fMRI) and representational similarity analysis to examine how visual and semantic representations predicted subsequent memory for single item encoding (e.g., seeing an orange). Three levels of visual representations corresponding to early, middle, and late visual processing stages were based on a deep neural network. Three levels of semantic representations were based on normative observed ("is round"), taxonomic ("is a fruit"), and encyclopedic features ("is sweet"). We identified brain regions where each representation type predicted later perceptual memory, conceptual memory, or both (general memory). Participants encoded objects during fMRI, and then completed both a word-based conceptual and picture-based perceptual memory test. Visual representations predicted subsequent perceptual memory in visual cortices, but also facilitated conceptual and general memory in more anterior regions. Semantic representations, in turn, predicted perceptual memory in visual cortex, conceptual memory in the perirhinal and inferior prefrontal cortex, and general memory in the angular gyrus. These results suggest that the contribution of visual and semantic representations to subsequent memory effects depends on a complex interaction between representation, test type, and storage location.
引用
收藏
页码:974 / 992
页数:19
相关论文
共 103 条
[91]   Towards a distributed account of conceptual knowledge [J].
Tyler, LK ;
Moss, HE .
TRENDS IN COGNITIVE SCIENCES, 2001, 5 (06) :244-252
[92]   Objects and Categories: Feature Statistics and Object Processing in the Ventral Stream [J].
Tyler, Lorraine K. ;
Chiu, Shannon ;
Zhuang, Jie ;
Randall, Billi ;
Devereux, Barry J. ;
Wright, Paul ;
Clarke, Alex ;
Taylor, Kirsten I. .
JOURNAL OF COGNITIVE NEUROSCIENCE, 2013, 25 (10) :1723-1735
[93]   Posterior parietal cortex and episodic encoding: Insights from fMRI subsequent memory effects and dual-attention theory [J].
Uncapher, Melina R. ;
Wagner, Anthony D. .
NEUROBIOLOGY OF LEARNING AND MEMORY, 2009, 91 (02) :139-154
[94]  
Ungerleider Leslie G., 1994, Current Opinion in Neurobiology, V4, P157, DOI 10.1016/0959-4388(94)90066-3
[95]   Corticocortical and thalamocortical information flow in the primate visual system [J].
Van Essen, DC .
CORTICAL FUNCTION: A VIEW FROM THE THALAMUS, 2005, 149 :173-185
[96]   Neural Encoding and Decoding with Deep Learning for Dynamic Natural Vision [J].
Wen, Haiguang ;
Shi, Junxing ;
Zhang, Yizhen ;
Lu, Kun-Han ;
Cao, Jiayue ;
Liu, Zhongming .
CEREBRAL CORTEX, 2018, 28 (12) :4136-4160
[97]  
Westfall Jacob, 2016, Wellcome Open Res, V1, P23, DOI 10.12688/wellcomeopenres.10298.2
[98]   ANALYSIS OF FMRI TIME-SERIES REVISITED - AGAIN [J].
WORSLEY, KJ ;
FRISTON, KJ .
NEUROIMAGE, 1995, 2 (03) :173-181
[99]   The perirhinal cortex and conceptual processing: Effects of feature-based statistics following damage to the anterior temporal lobes [J].
Wright, Paul ;
Randall, Billi ;
Clarke, Alex ;
Tyler, Lorraine K. .
NEUROPSYCHOLOGIA, 2015, 76 :192-207
[100]   Performance-optimized hierarchical models predict neural responses in higher visual cortex [J].
Yamins, Daniel L. K. ;
Hong, Ha ;
Cadieu, Charles F. ;
Solomon, Ethan A. ;
Seibert, Darren ;
DiCarlo, James J. .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2014, 111 (23) :8619-8624