Opportunities for increased reproducibility and replicability of developmental neuroimaging

被引:48
作者
Klapwijk, Eduard T. [1 ,2 ,3 ]
van den Bos, Wouter [4 ,5 ]
Tamnes, Christian K. [6 ,7 ,8 ,9 ]
Raschle, Nora M. [10 ]
Mills, Kathryn L. [6 ,11 ]
机构
[1] Erasmus Univ, Erasmus Sch Social & Behav Sci, Burgemeester Oudlaan 50, NL-3062 PA Rotterdam, Netherlands
[2] Leiden Univ, Inst Psychol, Leiden, Netherlands
[3] Leiden Inst Brain & Cognit, Leiden, Netherlands
[4] Univ Amsterdam, Dept Psychol, Amsterdam, Netherlands
[5] Max Planck Inst Human Dev, Ctr Adapt Rat, Berlin, Germany
[6] Univ Oslo, Dept Psychol, PROMENTA Res Ctr, Oslo, Norway
[7] Oslo Univ Hosp, Div Mental Hlth & Addict, NORMENT, Oslo, Norway
[8] Univ Oslo, Inst Clin Med, Oslo, Norway
[9] Diakonhjemmet Hosp, Dept Psychiat, Oslo, Norway
[10] Univ Zurich, Jacobs Ctr Prod Youth Dev, Zurich, Switzerland
[11] Univ Oregon, Dept Psychol, Eugene, OR 97403 USA
基金
欧洲研究理事会;
关键词
Development; Open science; Sample size; Cognitive neuroscience; Transparency; Preregistration; PROSPECTIVE MOTION CORRECTION; GENDERED CITATION PATTERNS; TEST-RETEST RELIABILITY; HEAD MOTION; SAMPLE-SIZE; BRAIN-DEVELOPMENT; POWER FAILURE; QUALITY; FMRI; ADOLESCENCE;
D O I
10.1016/j.dcn.2020.100902
中图分类号
B844 [发展心理学(人类心理学)];
学科分类号
040202 ;
摘要
Many workflows and tools that aim to increase the reproducibility and replicability of research findings have been suggested. In this review, we discuss the opportunities that these efforts offer for the field of developmental cognitive neuroscience, in particular developmental neuroimaging. We focus on issues broadly related to statistical power and to flexibility and transparency in data analyses. Critical considerations relating to statistical power include challenges in recruitment and testing of young populations, how to increase the value of studies with small samples, and the opportunities and challenges related to working with large-scale datasets. Developmental studies involve challenges such as choices about age groupings, lifespan modelling, analyses of longitudinal changes, and data that can be processed and analyzed in a multitude of ways. Flexibility in data acquisition, analyses and description may thereby greatly impact results. We discuss methods for improving transparency in developmental neuroimaging, and how preregistration can improve methodological rigor. While outlining challenges and issues that may arise before, during, and after data collection, solutions and resources are highlighted aiding to overcome some of these. Since the number of useful tools and techniques is evergrowing, we highlight the fact that many practices can be implemented stepwise.
引用
收藏
页数:19
相关论文
共 50 条
  • [1] Reporting checklists in neuroimaging: promoting transparency, replicability, and reproducibility
    Ekhtiari, Hamed
    Zare-Bidoky, Mehran
    Sangchooli, Arshiya
    Valyan, Alireza
    Abi-Dargham, Anissa
    Cannon, Dara M.
    Carter, Cameron S.
    Garavan, Hugh
    George, Tony P.
    Ghobadi-Azbari, Peyman
    Juchem, Christoph
    Krystal, John H.
    Nichols, Thomas E.
    Ongur, Dost
    Pernet, Cyril R.
    Poldrack, Russell A.
    Thompson, Paul M.
    Paulus, Martin P.
    NEUROPSYCHOPHARMACOLOGY, 2024, : 67 - 84
  • [2] Replicability and generalizability in population psychiatric neuroimaging
    Marek, Scott
    Laumann, Timothy O.
    NEUROPSYCHOPHARMACOLOGY, 2024, 50 (01) : 52 - 57
  • [3] Replicability and Reproducibility in Comparative Psychology
    Stevens, Jeffrey R.
    FRONTIERS IN PSYCHOLOGY, 2017, 8
  • [4] Promoting Reproducibility and Replicability in Political Science
    Brodeur, Abel
    Esterling, Kevin
    Ankel-Peters, Joerg
    Bueno, Natalia S.
    Desposato, Scott
    Dreber, Anna
    Genovese, Federica
    Green, Donald P.
    Hepplewhite, Matthew
    de la Guardia, Fernando Hoces
    Johannesson, Magnus
    Kotsadam, Andreas
    Miguel, Edward
    Velez, Yamil R.
    Young, Lauren
    RESEARCH & POLITICS, 2024, 11 (01)
  • [5] A framework for evaluating reproducibility and replicability in economics
    Dreber, Anna
    Johannesson, Magnus
    ECONOMIC INQUIRY, 2024,
  • [6] Reproducibility and replicability of science and thoracic surgery
    Lawton, Jennifer S.
    JOURNAL OF THORACIC AND CARDIOVASCULAR SURGERY, 2016, 152 (06) : 1489 - 1491
  • [7] The REPRISE project: protocol for an evaluation of REProducibility and Replicability In Syntheses of Evidence
    Page, Matthew J.
    Moher, David
    Fidler, Fiona M.
    Higgins, Julian P. T.
    Brennan, Sue E.
    Haddaway, Neal R.
    Hamilton, Daniel G.
    Kanukula, Raju
    Karunananthan, Sathya
    Maxwell, Lara J.
    McDonald, Steve
    Nakagawa, Shinichi
    Nunan, David
    Tugwell, Peter
    Welch, Vivian A.
    McKenzie, Joanne E.
    SYSTEMATIC REVIEWS, 2021, 10 (01)
  • [8] The REPRISE project: protocol for an evaluation of REProducibility and Replicability In Syntheses of Evidence
    Matthew J. Page
    David Moher
    Fiona M. Fidler
    Julian P. T. Higgins
    Sue E. Brennan
    Neal R. Haddaway
    Daniel G. Hamilton
    Raju Kanukula
    Sathya Karunananthan
    Lara J. Maxwell
    Steve McDonald
    Shinichi Nakagawa
    David Nunan
    Peter Tugwell
    Vivian A. Welch
    Joanne E. McKenzie
    Systematic Reviews, 10
  • [9] On reproducibility and replicability: Arguing for open science practices and methodological improvements at the South African Journal of Industrial Psychology
    Efendic, Emir
    van Zyl, Llewellyn E.
    SA JOURNAL OF INDUSTRIAL PSYCHOLOGY, 2019, 45
  • [10] Teaching Computational Reproducibility for Neuroimaging
    Millman, K. Jarrod
    Brett, Matthew
    Bamowski, Ross
    Poline, Jean-Baptiste
    FRONTIERS IN NEUROSCIENCE, 2018, 12