Self-regulation learning as active inference: dynamic causal modeling of an fMRI neurofeedback task

被引:3
作者
Vargas, Gabriela [1 ,2 ]
Araya, David [2 ,3 ]
Sepulveda, Pradyumna [4 ,5 ]
Rodriguez-Fernandez, Maria [1 ]
Friston, Karl J. [6 ]
Sitaram, Ranganatha [7 ]
El-Deredy, Wael [2 ,8 ,9 ]
机构
[1] Pontificia Univ Catolica Chile, Inst Biol & Med Engn, Sch Engn Med & Biol Sci, Santiago, Chile
[2] Univ Valparaiso, Brain Dynam Lab, Valparaiso, Chile
[3] Univ Andres Bello, Fac Ingn, Inst Tecnol Innovac Salud & Bienestar, Vina Del Mar, Chile
[4] UCL, Inst Cognit Neurosci, London, England
[5] Columbia Univ, Dept Psychiat, New York, NY USA
[6] UCL, Inst Neurol, Wellcome Ctr Human Neuroimaging, London, England
[7] St Jude Childrens Res Hosp, Memphis, TN USA
[8] Valencian Grad Sch & Res Network Artificial Intell, Valencia, Spain
[9] Univ Valencia, Sch Engn, Dept Elect Engn, Valencia, Spain
基金
英国惠康基金;
关键词
neurofeedback; brain-computer interface; fMRI; Active Inference; self-regulation learning;
D O I
10.3389/fnins.2023.1212549
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Introduction Learning to self-regulate brain activity by neurofeedback has been shown to lead to changes in the brain and behavior, with beneficial clinical and non-clinical outcomes. Neurofeedback uses a brain-computer interface to guide participants to change some feature of their brain activity. However, the neural mechanism of self-regulation learning remains unclear, with only 50% of the participants succeeding in achieving it. To bridge this knowledge gap, our study delves into the neural mechanisms of self-regulation learning via neurofeedback and investigates the brain processes associated with successful brain self-regulation.Methods We study the neural underpinnings of self-regulation learning by employing dynamical causal modeling (DCM) in conjunction with real-time functional MRI data. The study involved a cohort of 18 participants undergoing neurofeedback training targeting the supplementary motor area. A critical focus was the comparison between top-down hierarchical connectivity models proposed by Active Inference and alternative bottom-up connectivity models like reinforcement learning.Results Our analysis revealed a crucial distinction in brain connectivity patterns between successful and non-successful learners. Particularly, successful learners evinced a significantly stronger top-down effective connectivity towards the target area implicated in self-regulation. This heightened top-down network engagement closely resembles the patterns observed in goal-oriented and cognitive control studies, shedding light on the intricate cognitive processes intertwined with self-regulation learning.Discussion The findings from our investigation underscore the significance of cognitive mechanisms in the process of self-regulation learning through neurofeedback. The observed stronger top-down effective connectivity in successful learners indicates the involvement of hierarchical cognitive control, which aligns with the tenets of Active Inference. This study contributes to a deeper understanding of the neural dynamics behind successful self-regulation learning and provides insights into the potential cognitive architecture underpinning this process.
引用
收藏
页数:13
相关论文
共 43 条
[1]   Can We Predict Who Will Respond to Neurofeedback? A Review of the Inefficacy Problem and Existing Predictors for Successful EEG Neurofeedback Learning [J].
Alkoby, O. ;
Abu-Rmileh, A. ;
Shriki, O. ;
Todder, D. .
NEUROSCIENCE, 2018, 378 :155-164
[2]   Learning to Associate Orientation with Color in Early Visual Areas by Associative Decoded fMRI Neurofeedback [J].
Amano, Kaoru ;
Shibata, Kazuhisa ;
Kawato, Mitsuo ;
Sasaki, Yuka ;
Watanabe, Takeo .
CURRENT BIOLOGY, 2016, 26 (14) :1861-1866
[3]   Learning-induced autonomy of sensorimotor systems [J].
Bassett, Danielle S. ;
Yang, Muzhi ;
Wymbs, Nicholas F. ;
Grafton, Scott T. .
NATURE NEUROSCIENCE, 2015, 18 (05) :744-+
[4]   A Bayesian Account of Generalist and Specialist Formation Under the Active Inference Framework [J].
Chen, Anthony G. ;
Benrimoh, David ;
Parr, Thomas ;
Friston, Karl J. .
FRONTIERS IN ARTIFICIAL INTELLIGENCE, 2020, 3
[5]   Cognitive Control Over Learning: Creating, Clustering, and Generalizing Task-Set Structure [J].
Collins, Anne G. E. ;
Frank, Michael J. .
PSYCHOLOGICAL REVIEW, 2013, 120 (01) :190-229
[6]   Unconscious reinforcement learning of hidden brain states supported by confidence [J].
Cortese, Aurelio ;
Lau, Hakwan ;
Kawato, Mitsuo .
NATURE COMMUNICATIONS, 2020, 11 (01)
[7]   Active inference on discrete state-spaces: A synthesis [J].
Da Costa, Lancelot ;
Parr, Thomas ;
Sajid, Noor ;
Veselic, Sebastijan ;
Neacsu, Victorita ;
Friston, Karl .
JOURNAL OF MATHEMATICAL PSYCHOLOGY, 2020, 99
[8]   Dynamic causal modelling: A critical review of the biophysical and statistical foundations [J].
Daunizeau, J. ;
David, O. ;
Stephan, K. E. .
NEUROIMAGE, 2011, 58 (02) :312-322
[9]   Mental Load and Fatigue Assessment Instruments: A Systematic Review [J].
Diaz-Garcia, Jesus ;
Gonzalez-Ponce, Inmaculada ;
Ponce-Bordon, Jose Carlos ;
Lopez-Gajardo, Miguel angel ;
Ramirez-Bravo, Ivan ;
Rubio-Morales, Ana ;
Garcia-Calvo, Tomas .
INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH, 2022, 19 (01)
[10]   Meta-analysis of real-time fMRI neurofeedback studies using individual participant data: How is brain regulation mediated? [J].
Emmert, Kirsten ;
Kopel, Rotem ;
Sulzer, James ;
Bruehl, Annette B. ;
Berman, Brian D. ;
Linden, David E. J. ;
Horovitz, Silvina G. ;
Breimhorst, Markus ;
Caria, Andrea ;
Frank, Sabine ;
Johnston, Stephen ;
Long, Zhiying ;
Paret, Christian ;
Robineau, Fabien ;
Veit, Ralf ;
Bartsch, Andreas ;
Beckmann, Christian F. ;
Van De Ville, Dimitri ;
Haller, Sven .
NEUROIMAGE, 2016, 124 :806-812