Reliability and stability challenges in ABCD task fMRI data

被引:41
|
作者
Kennedy, James T. [1 ]
Harms, Michael P. [1 ]
Korucuoglu, Ozlem [1 ]
Astafiev, Serguei, V [1 ]
Barch, Deanna M. [1 ]
Thompson, Wesley K. [2 ,3 ]
Bjork, James M. [4 ]
Anokhin, Andrey P. [1 ]
机构
[1] Washington Univ, Sch Med, Dept Psychiat, Campus Box 8134,660 S Euclid Ave, St Louis, MO 63110 USA
[2] Univ Calif San Diego, Div Biostat, San Diego, CA USA
[3] Univ Calif San Diego, Dept Radiol, Populat Neurosci & Genet Lab, San Diego, CA 92103 USA
[4] Virginia Commonwealth Univ, Dept Psychiat, Richmond, VA USA
基金
美国国家卫生研究院;
关键词
TEST-RETEST RELIABILITY; HEAD MOTION; FUNCTIONAL MRI; WORKING-MEMORY; CONNECTIVITY; AMYGDALA; REWARD; ACTIVATION; PARCELLATION; METAANALYSIS;
D O I
10.1016/j.neuroimage.2022.119046
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Trait stability of measures is an essential requirement for individual differences research. Functional MRI has been increasingly used in studies that rely on the assumption of trait stability, such as attempts to relate task related brain activation to individual differences in behavior and psychopathology. However, recent research using adult samples has questioned the trait stability of task-fMRI measures, as assessed by test-retest correlations. To date, little is known about trait stability of task fMRI in children. Here, we examined within-session reliability and long-term stability of individual differences in task-fMRI measures using fMRI measures of brain activation provided by the adolescent brain cognitive development (ABCD) Study Release v4.0 as an individual's average regional activity, using its tasks focused on reward processing, response inhibition, and working memory. We also evaluated the effects of factors potentially affecting reliability and stability. Reliability and stability (quantified as the ratio of non-scanner related stable variance to all variances) was poor in virtually all brain regions, with an average value of 0.088 and 0.072 for short term (within-session) reliability and long-term (between-session) stability, respectively, in regions of interest (ROIs) historically-recruited by the tasks. Only one reliability or stability value in ROIs exceeded the 'poor' cut-offof 0.4, and in fact rarely exceeded 0.2 (only 4.9%). Motion had a pronounced effect on estimated reliability/stability, with the lowest motion quartile of participants having a mean reliability/stability 2.5 times higher (albeit still 'poor') than the highest motion quartile. Poor reliability and stability of task-fMRI, particularly in children, diminishes potential utility of fMRI data due to a drastic reduction of effect sizes and, consequently, statistical power for the detection of brain-behavior associations. This essential issue urgently needs to be addressed through optimization of task design, scanning parameters, data acquisition protocols, preprocessing pipelines, and data denoising methods.
引用
收藏
页数:16
相关论文
共 50 条
  • [31] Sensitivity and reliability of language laterality assessment with a free reversed association task—a fMRI study
    Gunther Fesl
    Philipp Bruhns
    Sabine Rau
    Martin Wiesmann
    Josef Ilmberger
    Gerd Kegel
    Hartmut Brueckmann
    European Radiology, 2010, 20 : 683 - 695
  • [32] Topological data analysis of task-based fMRI data from experiments on schizophrenia
    Stolz, Bernadette J.
    Emerson, Tegan
    Nahkuri, Satu
    Porter, Mason A.
    Harrington, Heather A.
    JOURNAL OF PHYSICS-COMPLEXITY, 2021, 2 (03):
  • [33] Dual-task Assessment Of Concussion: Switch-task Stability Reliability Estimation
    Tomporowski, Phillip D.
    Cooper, Stephanie L.
    Okumura, Michelle S.
    Ferrara, Michael S.
    MEDICINE AND SCIENCE IN SPORTS AND EXERCISE, 2012, 44 : 410 - 410
  • [34] GaN Power Devices: Challenges for Improved Stability and Reliability
    Meneghini, Matteo
    2022 IEEE INTERNATIONAL RELIABILITY PHYSICS SYMPOSIUM (IRPS), 2022,
  • [35] The variability of serial fMRI data: Correlation between a visual and a motor task
    Waldvogel, D
    van Gelderen, P
    Immisch, I
    Pfeiffer, C
    Hallett, M
    NEUROREPORT, 2000, 11 (17) : 3843 - 3847
  • [36] Decoding Behavioral Accuracy in an Attention Task Using Brain fMRI Data
    Wang, Zhe
    Zheng, Yu
    Jigo, Michael
    Liu, Taosheng
    Ren, Jian
    Tian, Zhi
    Li, Tongtong
    2018 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2018,
  • [37] Reliability Meets Big Data: Opportunities and Challenges
    Meeker, William Q.
    Hong, Yili
    QUALITY ENGINEERING, 2014, 26 (01) : 102 - 116
  • [38] Task fMRI data analysis based on supervised stochastic coordinate coding
    Lv, Jinglei
    Ling, Binbin
    Li, Qingyang
    Zhang, Wei
    Zhao, Yu
    Jiang, Xi
    Guo, Lei
    Han, Junwei
    Hu, Xintao
    Guo, Christine
    Ye, Jieping
    Liu, Tianming
    MEDICAL IMAGE ANALYSIS, 2017, 38 : 1 - 16
  • [39] A systematic revision of brain connectivity in fMRI data in linguistic task paradigms
    Guardia-Olmos, J.
    Gudayol-Ferre, E.
    Pero-Cebollero, M.
    INTERNATIONAL JOURNAL OF PSYCHOPHYSIOLOGY, 2018, 131 : S56 - S56
  • [40] fMRI data acquisition and analysis for task-free, anesthetized rats
    Vrooman, Roel M.
    van den Berg, Monica
    Desrosiers-Gregoire, Gabriel
    van Engelenburg, Wessel A.
    Galteau, Marie E.
    Lee, Sung-Ho
    Veltien, Andor
    Barriere, David A.
    Cash, Diana
    Chakravarty, M. Mallar
    Devenyi, Gabriel A.
    Gozzi, Alessandro
    Groehn, Olli
    Hess, Andreas
    Homberg, Judith R.
    Jelescu, Ileana O.
    Keliris, Georgios A.
    Scheenen, Tom
    Shih, Yen-Yu Ian
    Verhoye, Marleen
    Wary, Claire
    Zwiers, Marcel
    Grandjean, Joanes
    NATURE PROTOCOLS, 2025,