Reproducibility and replicability of rodent phenotyping in preclinical studies

被引:134
作者
Kafkafi, Neri [1 ]
Agassi, Joseph [1 ]
Chesler, Elissa J. [2 ]
Crabbe, John C. [3 ,4 ]
Crusio, Wim E. [5 ,6 ]
Eilam, David [1 ]
Gerlai, Robert [7 ]
Goiani, Ilan [1 ]
Gomez-Marin, Alex [8 ]
Heller, Ruth [1 ]
Iraqi, Fuad [1 ]
Jaljuli, Iman [1 ]
Karp, Natasha A. [9 ]
Morgan, Hugh [10 ]
Nicholson, George [11 ]
Pfaff, Donald W. [12 ]
Richter, S. Helene [13 ]
Stark, Philip B. [14 ]
Stiedl, Oliver [15 ]
Stodden, Victoria [16 ]
Tarantino, Lisa M. [17 ]
Tucci, Valter [18 ]
Valdar, William [17 ]
Williams, Robert W. [19 ]
Wurbel, Hanno [20 ]
Benjamini, Yoav [1 ]
机构
[1] Tel Aviv Univ, Tel Aviv, Israel
[2] Jackson Lab, 600 Main St, Bar Harbor, ME 04609 USA
[3] Oregon Hlth & Sci Univ, Portland, OR 97201 USA
[4] VA Portland Hlth Care Syst, Portland, OR USA
[5] Univ Bordeaux, INCIA, Bordeaux, France
[6] CNRS, Paris, France
[7] Univ Toronto, Toronto, ON, Canada
[8] CSIC UMH, Inst Neurociencias, Alicante, Spain
[9] AstraZeneca, Discovery Sci, IMED Biotech Unit, Cambridge, England
[10] Harwell Res Ctr, Didcot, Oxon, England
[11] Univ Oxford, Oxford, England
[12] Rockefeller Univ, 1230 York Ave, New York, NY 10021 USA
[13] Univ Munster, Munster, Germany
[14] Univ Calif Berkeley, Berkeley, CA 94720 USA
[15] Vrije Univ Amsterdam, Amsterdam, Netherlands
[16] Univ Illinois, Champaign, IL USA
[17] Univ North Carolina Chapel Hill, Chapel Hill, NC USA
[18] Ist Italiano Tecnol, Genoa, Italy
[19] Univ Tennessee, Hlth Sci Ctr, Knoxville, TN 37996 USA
[20] Univ Bern, Bern, Switzerland
基金
欧洲研究理事会;
关键词
Reproducibility; Replicability; GxE interaction; Validity; Data sharing; False discoveries; Heterogenization; FALSE DISCOVERY RATE; ANIMAL-MODELS; COLLABORATIVE CROSS; MOUSE BEHAVIOR; LABORATORY ENVIRONMENT; HIPPOCAMPAL FUNCTION; EXPERIMENTAL-DESIGN; TRANSGENIC MICE; COMPLEX TRAITS; DATA RESOURCES;
D O I
10.1016/j.neubiorev.2018.01.003
中图分类号
B84 [心理学]; C [社会科学总论]; Q98 [人类学];
学科分类号
03 ; 0303 ; 030303 ; 04 ; 0402 ;
摘要
The scientific community is increasingly concerned with the proportion of published "discoveries" that are not replicated in subsequent studies. The field of rodent behavioral phenotyping was one of the first to raise this concern, and to relate it to other methodological issues: the complex interaction between genotype and environment; the definitions of behavioral constructs; and the use of laboratory mice and rats as model species for investigating human health and disease mechanisms. In January 2015, researchers from various disciplines gathered at Tel Aviv University to discuss these issues. The general consensus was that the issue is prevalent and of concern, and should be addressed at the statistical, methodological and policy levels, but is not so severe as to call into question the validity and the usefulness of model organisms as a whole. Well-organized community efforts, coupled with improved data and metadata sharing, have a key role in identifying specific problems and promoting effective solutions. Replicability is closely related to validity, may affect generalizability and translation of findings, and has important ethical implications.
引用
收藏
页码:218 / 232
页数:15
相关论文
共 190 条
[101]   Improving the Identification of Phenotypic Abnormalities and Sexual Dimorphism in Mice When Studying Rare Event Categorical Characteristics [J].
Karp, Natasha A. ;
Heller, Ruth ;
Yaacoby, Shay ;
White, Jacqueline K. ;
Benjamini, Yoav .
GENETICS, 2017, 205 (02) :491-501
[102]   Applying the ARRIVE Guidelines to an In Vivo Database [J].
Karp, Natasha A. ;
Meehan, Terry F. ;
Morgan, Hugh ;
Mason, Jeremy C. ;
Blake, Andrew ;
Kurbatova, Natalja ;
Smedley, Damian ;
Jacobsen, Julius ;
Mott, Richard F. ;
Iyer, Vivek ;
Matthews, Peter ;
Melvin, David G. ;
Wells, Sara ;
Flenniken, Ann M. ;
Masuya, Hiroshi ;
Wakana, Shigeharu ;
White, Jacqueline K. ;
Lloyd, K. C. Kent ;
Reynolds, Corey L. ;
Paylor, Richard ;
West, David B. ;
Svenson, Karen L. ;
Chesler, Elissa J. ;
de Angelis, Martin Hrabe ;
Tocchini-Valentini, Glauco P. ;
Sorg, Tania ;
Herault, Yann ;
Parkinson, Helen ;
Mallon, Ann-Marie ;
Brown, Steve D. M. .
PLOS BIOLOGY, 2015, 13 (05)
[103]   Impact of Temporal Variation on Design and Analysis of Mouse Knockout Phenotyping Studies [J].
Karp, Natasha A. ;
Speak, Anneliese O. ;
White, Jacqueline K. ;
Adams, David J. ;
de Angelis, Martin Hrabe ;
Herault, Yann ;
Mott, Richard F. .
PLOS ONE, 2014, 9 (10)
[104]   Pituitary tumor-transforming gene 1 regulates the patterning of retinal mosaics [J].
Keeley, Patrick W. ;
Zhou, Cuiqi ;
Lu, Lu ;
Williams, Robert W. ;
Melmed, Shlomo ;
Reese, Benjamin E. .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2014, 111 (25) :9295-9300
[105]   Clarifying the terminology that describes scientific reproducibility [J].
Kenett, Ron S. ;
Shmueli, Galit .
NATURE METHODS, 2015, 12 (08) :699-699
[106]   The International Mouse Phenotyping Consortium Web Portal, a unified point of access for knockout mice and related phenotyping data [J].
Koscielny, Gautier ;
Yaikhom, Gagarine ;
Iyer, Vivek ;
Meehan, Terrence F. ;
Morgan, Hugh ;
Atienza-Herrero, Julian ;
Blake, Andrew ;
Chen, Chao-Kung ;
Easty, Richard ;
Di Fenza, Armida ;
Fiegel, Tanja ;
Grifiths, Mark ;
Horne, Alan ;
Karp, Natasha A. ;
Kurbatova, Natalja ;
Mason, Jeremy C. ;
Matthews, Peter ;
Oakley, Darren J. ;
Qazi, Asfand ;
Regnart, Jack ;
Retha, Ahmad ;
Santos, Luis A. ;
Sneddon, Duncan J. ;
Warren, Jonathan ;
Westerberg, Henrik ;
Wilson, Robert J. ;
Melvin, David G. ;
Smedley, Damian ;
Brown, Steve D. M. ;
Flicek, Paul ;
Skarnes, William C. ;
Mallon, Ann-Marie ;
Parkinson, Helen .
NUCLEIC ACIDS RESEARCH, 2014, 42 (D1) :D802-D809
[107]   Identification of the UBP1 Locus as a Critical Blood Pressure Determinant Using a Combination of Mouse and Human Genetics [J].
Koutnikova, Hana ;
Laakso, Markku ;
Lu, Lu ;
Combe, Roy ;
Paananen, Jussi ;
Kuulasmaa, Teemu ;
Kuusisto, Johanna ;
Haering, Hans-Ulrich ;
Hansen, Torben ;
Pedersen, Oluf ;
Smith, Ulf ;
Hanefeld, Markolf ;
Williams, Robert W. ;
Auwerx, Johan .
PLOS GENETICS, 2009, 5 (08)
[108]   Neuroscience Needs Behavior: Correcting a Reductionist Bias [J].
Krakauer, John W. ;
Ghazanfar, Asif A. ;
Gomez-Marin, Alex ;
MacIver, Malcolm A. ;
Poeppel, David .
NEURON, 2017, 93 (03) :480-490
[109]   Behavioural battery testing: Evaluation and behavioural outcomes in 8 inbred mouse strains [J].
Lad, Heena Vanmalibhai ;
Liu, Lin ;
Paya-Cano, Jose Luis ;
Parsons, Michael James ;
Kember, Rachel ;
Fernandes, Cathy ;
Schalkwyk, Leonard Cornelis .
PHYSIOLOGY & BEHAVIOR, 2010, 99 (03) :301-316
[110]   GENETIC DISSECTION OF COMPLEX TRAITS - GUIDELINES FOR INTERPRETING AND REPORTING LINKAGE RESULTS [J].
LANDER, E ;
KRUGLYAK, L .
NATURE GENETICS, 1995, 11 (03) :241-247