Image categorization from functional magnetic resonance imaging using functional connectivity

被引:4
作者
Liu, Chunyu [1 ]
Song, Sutao [2 ]
Guo, Xiaojuan [1 ]
Zhu, Zhiyuan [1 ]
Zhang, Jiacai [1 ]
机构
[1] Beijing Normal Univ, Coll Informat Sci & Technol, Beijing, Peoples R China
[2] Univ Jinan, Sch Educ & Psychol, Jinan, Shandong, Peoples R China
关键词
Machine learning; Random Forest; Support Vector Machine; Functional connectivity; Image categorization; WHOLE-BRAIN; ACTIVATION; PATTERNS; SUBJECT; FMRI; FACE; REPRESENTATIONS; CLASSIFICATION; FLUCTUATIONS; COGNITION;
D O I
10.1016/j.jneumeth.2018.08.021
中图分类号
Q5 [生物化学];
学科分类号
071010 ; 081704 ;
摘要
Background: Previous studies have attempted to infer the category of objects in a stimulus image from functional magnetic resonance imaging (fMRI) data recoded during image-viewing. Most studies focus on extracting activity patterns within a given region or across multiple voxels, and utilize the relationships among voxels to decipher the category of a stimulus image. Yet, the functional connectivity (FC) patterns across regions of interest in response to image categories, and their potential contributions to category classification are largely unknown. New method: We investigated whole-brain FC patterns in response to 4 image category stimuli (cats, faces, houses, and vehicles) using fMRI in healthy adult volunteers, and classified FC patterns using machine learning framework (Support Vector Machine [SVM] and Random Forest). We further examined the FC robustness and the influence of the window length on FC patterns for neural decoding. Results: The average one-vs.-one classification accuracy of the two classification models were 74% within subjects and 80% between subjects, which are higher than the chance level (50%). The Random Forest results were better than SVM results, and the 48-s FC results were better than the 24-s FC results. Comparison with existing method(s): We compared the classification performance of our FC patterns with two other existing methods, inter-block and intra-block, without overlapping temporal information. Conclusions: Whole-brain FC patterns for different window lengths (24 and 48 s) can predict images categories with high accuracy. These results reveal novel mechanisms underlying the representation of categorical information in large-scale FC patterns in the human brain.
引用
收藏
页码:71 / 80
页数:10
相关论文
共 47 条
[1]   Tracking Whole-Brain Connectivity Dynamics in the Resting State [J].
Allen, Elena A. ;
Damaraju, Eswar ;
Plis, Sergey M. ;
Erhardt, Erik B. ;
Eichele, Tom ;
Calhoun, Vince D. .
CEREBRAL CORTEX, 2014, 24 (03) :663-676
[2]   Sliding-window analysis tracks fluctuations in amygdala functional connectivity associated with physiological arousal and vigilance during fear conditioning [J].
Baczkowski, Blazej M. ;
Johnstone, Tom ;
Walter, Henrik ;
Erk, Susanne ;
Veer, Ilya M. .
NEUROIMAGE, 2017, 153 :168-178
[3]   Scaling of Neural Responses to Visual and Auditory Motion in the Human Cerebellum [J].
Baumann, Oliver ;
Mattingley, Jason B. .
JOURNAL OF NEUROSCIENCE, 2010, 30 (12) :4489-4495
[4]   Random forests [J].
Breiman, L .
MACHINE LEARNING, 2001, 45 (01) :5-32
[5]   Complex brain networks: graph theoretical analysis of structural and functional systems [J].
Bullmore, Edward T. ;
Sporns, Olaf .
NATURE REVIEWS NEUROSCIENCE, 2009, 10 (03) :186-198
[6]   Neural portraits of perception: Reconstructing face images from evoked brain activity [J].
Cowen, Alan S. ;
Chun, Marvin M. ;
Kuhl, Brice A. .
NEUROIMAGE, 2014, 94 :12-22
[7]   Dynamic connectivity regression: Determining state-related changes in brain connectivity [J].
Cribben, Ivor ;
Haraldsdottir, Ragnheidur ;
Atlas, Lauren Y. ;
Wager, Tor D. ;
Lindquist, Martin A. .
NEUROIMAGE, 2012, 61 (04) :907-920
[8]   What do differences between multi-voxel and univariate analysis mean? How subject-, voxel-, and trial-level variance impact fMRI analysis [J].
Davis, Tyler ;
LaRocque, Karen F. ;
Mumford, Jeanette A. ;
Norman, Kenneth A. ;
Wagner, Anthony D. ;
Poldrack, Russell A. .
NEUROIMAGE, 2014, 97 :271-283
[9]   Multiplexed Echo Planar Imaging for Sub-Second Whole Brain FMRI and Fast Diffusion Imaging [J].
Feinberg, David A. ;
Moeller, Steen ;
Smith, Stephen M. ;
Auerbach, Edward ;
Ramanna, Sudhir ;
Glasser, Matt F. ;
Miller, Karla L. ;
Ugurbil, Kamil ;
Yacoub, Essa .
PLOS ONE, 2010, 5 (12)
[10]   Beyond threat: Amygdala reactivity across multiple expressions of facial affect [J].
Fitzgerald, Daniel A. ;
Angstadt, Mike ;
Jelsone, Laura M. ;
Nathan, Pradeep J. ;
Phan, K. Luan .
NEUROIMAGE, 2006, 30 (04) :1441-1448