Decoding stimuli (tool-hand) and viewpoint invariant grasp-type information

被引:5
作者
Bergstrom, Fredrik [1 ,2 ]
Wurm, Moritz [3 ]
Valerio, Daniela [1 ,2 ]
Lingnau, Angelika [3 ,4 ]
Almeida, Jorge [1 ,2 ]
机构
[1] Univ Coimbra, Fac Psychol & Educ Sci, Proact Lab, Coimbra, Portugal
[2] Univ Coimbra, Fac Psychol & Educ Sci, Rua Colegio Novo, P-3001802 Coimbra, Portugal
[3] Univ Trento, Ctr Mind Brain Sci CIMeC, Rovereto, TN, Italy
[4] Univ Regensburg, Inst Psychol, Regensburg, Germany
基金
欧洲研究理事会;
关键词
fMRI; Hands; Parietal cortex; Prehension; Tools; HUMAN ANTERIOR INTRAPARIETAL; TUNING REVEALS INTERACTIONS; FALSE DISCOVERY RATE; OCCIPITOTEMPORAL CORTEX; OBJECT REPRESENTATIONS; FUNCTIONAL-PROPERTIES; SPATIAL-FREQUENCY; NEURAL RESPONSES; PARIETAL CORTEX; AREA F5;
D O I
10.1016/j.cortex.2021.03.004
中图分类号
B84 [心理学]; C [社会科学总论]; Q98 [人类学];
学科分类号
03 ; 0303 ; 030303 ; 04 ; 0402 ;
摘要
When we see a manipulable object (henceforth tool) or a hand performing a grasping movement, our brain is automatically tuned to how that tool can be grasped (i.e., its affordance) or what kind of grasp that hand is performing (e.g., a power or precision grasp). However, it remains unclear where visual information related to tools or hands are transformed into abstract grasp representations. We therefore investigated where different levels of abstractness in grasp information are processed: grasp information that is invariant to the kind of stimuli that elicits it (tool-hand invariance); and grasp information that is hand-specific but viewpoint-invariant (viewpoint invariance). We focused on brain areas activated when viewing both tools and hands, i.e., the posterior parietal cortices (PPC), ventral premotor cortices (PMv), and lateral occipitotemporal cortex/posterior middle temporal cortex (LOTC/pMTG). To test for invariant grasp representations, we presented participants with tool images and grasp videos (from first or third person perspective; 1pp or 3pp) inside an MRI scanner, and cross-decoded power versus precision grasps across (i) grasp perspectives (viewpoint invariance), (ii) tool images and grasp 1pp videos (tool-hand 1pp invariance), and (iii) tool images and grasp 3pp videos (tool-hand 3pp invariance). Tool-hand 1pp, but not tool-hand 3pp, invariant grasp information was found in left PPC, whereas viewpoint-invariant information was found bilaterally in PPC, left PMv, and left LOTC/pMTG. These findings suggest different levels of abstractness-where visual information is transformed into stimuli-invariant grasp representations/tool affordances in left PPC, and viewpoint invariant but hand-specific grasp representations in the hand network. (c) 2021 Elsevier Ltd. All rights reserved.
引用
收藏
页码:152 / 165
页数:14
相关论文
共 95 条
[1]   Visual and visuomotor processing of hands and tools as a case study of cross talk between the dorsal and ventral streams [J].
Almeida, Jorge ;
Amaral, Lenia ;
Garcea, Frank E. ;
de Sousa, Diana Aguiar ;
Xu, Shan ;
Mahon, Bradford Z. ;
Martins, Isabel Pavao .
COGNITIVE NEUROPSYCHOLOGY, 2018, 35 (5-6) :288-303
[2]   Polarity-specific transcranial direct current stimulation effects on object-selective neural responses in the inferior parietal lobe [J].
Almeida, Jorge ;
Martins, Ana R. ;
Bergstrom, Fredrik ;
Amaral, Lenia ;
Freixo, Andreia ;
Ganho-Auila, Ana ;
Kristensen, Stephanie ;
Lee, Dongha ;
Nogueira, Joana ;
Ruttorf, Michaela .
CORTEX, 2017, 94 :176-181
[3]   Tool manipulation knowledge is retrieved by way of the ventral visual object processing pathway [J].
Almeida, Jorge ;
Fintzi, Anat R. ;
Mahon, Bradford Z. .
CORTEX, 2013, 49 (09) :2334-2344
[4]   The Role of the Dorsal Visual Processing Stream in Tool Identification [J].
Almeida, Jorge ;
Mahon, Bradford Z. ;
Caramazza, Alfonso .
PSYCHOLOGICAL SCIENCE, 2010, 21 (06) :772-778
[5]   Decoding Internally and Externally Driven Movement Plans [J].
Ariani, Giacomo ;
Wurm, Moritz F. ;
Lingnau, Angelika .
JOURNAL OF NEUROSCIENCE, 2015, 35 (42) :14160-14171
[6]   A fast diffeomorphic image registration algorithm [J].
Ashburner, John .
NEUROIMAGE, 2007, 38 (01) :95-113
[7]   Context-Specific Grasp Movement Representation in the Macaque Anterior Intraparietal Area [J].
Baumann, Markus A. ;
Fluet, Marie-Christine ;
Scherberger, Hansjoerg .
JOURNAL OF NEUROSCIENCE, 2009, 29 (20) :6436-6448
[8]   Parallel visual motion processing streams for manipulable objects and human movements [J].
Beauchamp, MS ;
Lee, KE ;
Haxby, JV ;
Martin, A .
NEURON, 2002, 34 (01) :149-159
[9]   Differential cortical activity for precision and whole-hand visually guided grasping in humans [J].
Begliomini, Chiara ;
Wall, Matthew B. ;
Smith, Andrew T. ;
Castiello, Umberto .
EUROPEAN JOURNAL OF NEUROSCIENCE, 2007, 25 (04) :1245-1252
[10]  
Benjamini Y, 2001, ANN STAT, V29, P1165