Reliability and stability challenges in ABCD task fMRI data

被引:41
|
作者
Kennedy, James T. [1 ]
Harms, Michael P. [1 ]
Korucuoglu, Ozlem [1 ]
Astafiev, Serguei, V [1 ]
Barch, Deanna M. [1 ]
Thompson, Wesley K. [2 ,3 ]
Bjork, James M. [4 ]
Anokhin, Andrey P. [1 ]
机构
[1] Washington Univ, Sch Med, Dept Psychiat, Campus Box 8134,660 S Euclid Ave, St Louis, MO 63110 USA
[2] Univ Calif San Diego, Div Biostat, San Diego, CA USA
[3] Univ Calif San Diego, Dept Radiol, Populat Neurosci & Genet Lab, San Diego, CA 92103 USA
[4] Virginia Commonwealth Univ, Dept Psychiat, Richmond, VA USA
基金
美国国家卫生研究院;
关键词
TEST-RETEST RELIABILITY; HEAD MOTION; FUNCTIONAL MRI; WORKING-MEMORY; CONNECTIVITY; AMYGDALA; REWARD; ACTIVATION; PARCELLATION; METAANALYSIS;
D O I
10.1016/j.neuroimage.2022.119046
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Trait stability of measures is an essential requirement for individual differences research. Functional MRI has been increasingly used in studies that rely on the assumption of trait stability, such as attempts to relate task related brain activation to individual differences in behavior and psychopathology. However, recent research using adult samples has questioned the trait stability of task-fMRI measures, as assessed by test-retest correlations. To date, little is known about trait stability of task fMRI in children. Here, we examined within-session reliability and long-term stability of individual differences in task-fMRI measures using fMRI measures of brain activation provided by the adolescent brain cognitive development (ABCD) Study Release v4.0 as an individual's average regional activity, using its tasks focused on reward processing, response inhibition, and working memory. We also evaluated the effects of factors potentially affecting reliability and stability. Reliability and stability (quantified as the ratio of non-scanner related stable variance to all variances) was poor in virtually all brain regions, with an average value of 0.088 and 0.072 for short term (within-session) reliability and long-term (between-session) stability, respectively, in regions of interest (ROIs) historically-recruited by the tasks. Only one reliability or stability value in ROIs exceeded the 'poor' cut-offof 0.4, and in fact rarely exceeded 0.2 (only 4.9%). Motion had a pronounced effect on estimated reliability/stability, with the lowest motion quartile of participants having a mean reliability/stability 2.5 times higher (albeit still 'poor') than the highest motion quartile. Poor reliability and stability of task-fMRI, particularly in children, diminishes potential utility of fMRI data due to a drastic reduction of effect sizes and, consequently, statistical power for the detection of brain-behavior associations. This essential issue urgently needs to be addressed through optimization of task design, scanning parameters, data acquisition protocols, preprocessing pipelines, and data denoising methods.
引用
收藏
页数:16
相关论文
共 50 条
  • [41] PV DATA - ABCD
    ALBERTSO.CE
    MATERIALS IN DESIGN ENGINEERING, 1967, 65 (03): : 10 - &
  • [42] The ABCD of data management
    Peter Kirkpatrick
    Nature Reviews Drug Discovery, 2007, 6 : 956 - 957
  • [43] Multivariate linear approach to fMRI data in stroop task performance in depression
    Paunova, Rositsa
    Kandilarova, Sevdalina
    Simeonova, Denitsa
    Najar, Diyana
    Latypova, Adeliya
    Stoyanov, Drozdstoy
    Kherif, Ferath
    EUROPEAN PHYSICAL JOURNAL-SPECIAL TOPICS, 2025,
  • [44] Simultaneous EEG-fMRI Data Acquisition during Cognitive Task
    Ahmad, Rana Fayyaz
    Malik, Aamir Saeed
    Kamel, Nidal
    Reza, Faruque
    Karim, Ahmad Helmy Abdul
    2014 5TH INTERNATIONAL CONFERENCE ON INTELLIGENT AND ADVANCED SYSTEMS (ICIAS 2014), 2014,
  • [45] Modeling Task FMRI Data via Supervised Stochastic Coordinate Coding
    Lv, Jinglei
    Lin, Binbin
    Zhang, Wei
    Jiang, Xi
    Hu, Xintao
    Han, Junwei
    Guo, Lei
    Ye, Jieping
    Liu, Tianming
    MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION - MICCAI 2015, PT I, 2015, 9349 : 239 - 246
  • [46] MODELING TASK FMRI DATA VIA MIXTURE OF DEEP EXPERT NETWORKS
    Huang, Heng
    Hu, Xintao
    Dong, Qinglin
    Zhao, Shijie
    Zhang, Shu
    Zhao, Yu
    Guo, Lei
    Liu, Tianming
    2018 IEEE 15TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (ISBI 2018), 2018, : 82 - 86
  • [47] Dynamic Causal Modeling applied to fMRI data shows high reliability
    Schuyler, Brianna
    Ollinger, John M.
    Oakes, Terrence R.
    Johnstone, Tom
    Davidson, Richard J.
    NEUROIMAGE, 2010, 49 (01) : 603 - 611
  • [48] Constrained Learning of Task-Related and Spatially-Coherent Dictionaries from Task fMRI Data
    Ramakrishnapillai, Sreekrishna
    Lieberman, Harris R.
    Rood, Jennifer C.
    Pasiakos, Stefan M.
    Murray, Kori
    Shankapal, Preetham
    Carmichael, Owen T.
    MACHINE LEARNING IN CLINICAL NEUROIMAGING, 2021, 13001 : 165 - 173
  • [49] Two for the Price of One? Analyzing Task-based fMRI Data with Resting-State fMRI Methods
    Field, Aaron
    Birn, Rasmus
    RADIOLOGY, 2021, 301 (01) : 185 - 186
  • [50] Sensitivity and reliability of language laterality assessment with a free reversed association task-a fMRI study
    Fesl, Gunther
    Bruhns, Philipp
    Rau, Sabine
    Wiesmann, Martin
    Ilmberger, Josef
    Kegel, Gerd
    Brueckmann, Hartmut
    EUROPEAN RADIOLOGY, 2010, 20 (03) : 683 - 695