A Validity-Based Framework for Understanding Replication in Psychology

被引：52

作者：

Fabrigar, Leandre R. ^{[1
]}

Wegener, Duane T. ^{[2
]}

Petty, Richard E. ^{[2
]}

机构：

[1] Queens Univ, Kingston, ON, Canada

[2] Ohio State Univ, Columbus, OH 43210 USA

来源：

PERSONALITY AND SOCIAL PSYCHOLOGY REVIEW | 2020年 / 24卷 / 04期

关键词：

research methods; replication; statistical conclusion validity; construct validity; internal validity; external validity; OBJECTIVE SELF-AWARENESS; CONTEXTUAL SENSITIVITY; SOCIAL-PSYCHOLOGY; NEED; PERSUASION; REPLICABILITY; PERSONALITY; COGNITION; INCREASE; MANIPULATIONS;

D O I：

10.1177/1088868320931366

中图分类号：

B84 [心理学];

学科分类号：

04 ; 0402 ;

摘要：

In recent years, psychology has wrestled with the broader implications of disappointing rates of replication of previously demonstrated effects. This article proposes that many aspects of this pattern of results can be understood within the classic framework of four proposed forms of validity: statistical conclusion validity, internal validity, construct validity, and external validity. The article explains the conceptual logic for how differences in each type of validity across an original study and a subsequent replication attempt can lead to replication "failure." Existing themes in the replication literature related to each type of validity are also highlighted. Furthermore, empirical evidence is considered for the role of each type of validity in non-replication. The article concludes with a discussion of broader implications of this classic validity framework for improving replication rates in psychological research.

引用

页码：316 / 344

页数：29

共 150 条

[1] Estimating the reproducibility of psychological science [J].

Aarts, Alexander A. ;

Anderson, Joanna E. ;

Anderson, Christopher J. ;

Attridge, Peter R. ;

Attwood, Angela ;

Axt, Jordan ;

Babel, Molly ;

Bahnik, Stepan ;

Baranski, Erica ;

Barnett-Cowan, Michael ;

Bartmess, Elizabeth ;

Beer, Jennifer ;

Bell, Raoul ;

Bentley, Heather ;

Beyan, Leah ;

Binion, Grace ;

Borsboom, Denny ;

Bosch, Annick ;

Bosco, Frank A. ;

Bowman, Sara D. ;

Brandt, Mark J. ;

Braswell, Erin ;

Brohmer, Hilmar ;

Brown, Benjamin T. ;

Brown, Kristina ;

Bruening, Jovita ;

Calhoun-Sauls, Ann ;

Callahan, Shannon P. ;

Chagnon, Elizabeth ;

Chandler, Jesse ;

Chartier, Christopher R. ;

Cheung, Felix ;

Christopherson, Cody D. ;

Cillessen, Linda ;

Clay, Russ ;

Cleary, Hayley ;

Cloud, Mark D. ;

Cohn, Michael ;

Cohoon, Johanna ;

Columbus, Simon ;

Cordes, Andreas ;

Costantini, Giulio ;

Alvarez, Leslie D. Cramblet ;

Cremata, Ed ;

Crusius, Jan ;

DeCoster, Jamie ;

DeGaetano, Michelle A. ;

Della Penna, Nicolas ;

den Bezemer, Bobby ;

Deserno, Marie K. .

SCIENCE, 2015, 349 (6251)

[2] Registered Replication Report: Schooler and Engstler-Schooler (1990) [J].

Alogna, V. K. ;

Attaya, M. K. ;

Aucoin, P. ;

Bahnik, S. ;

Birch, S. ;

Birt, A. R. ;

Bornstein, B. H. ;

Bouwmeester, S. ;

Brandimonte, M. A. ;

Brown, C. ;

Buswell, K. ;

Carlson, C. ;

Carlson, M. ;

Chu, S. ;

Cislak, A. ;

Colarusso, M. ;

Colloff, M. F. ;

Dellapaolera, K. S. ;

Delvenne, J.-F. ;

Di Domenico, A. ;

Drummond, A. ;

Echterhoff, G. ;

Edlund, J. E. ;

Eggleston, C. M. ;

Fairfield, B. ;

Franco, G. ;

Gabbert, F. ;

Gamblin, B. W. ;

Garry, M. ;

Gentry, R. ;

Gilbert, E. A. ;

Greenberg, D. L. ;

Halberstadt, J. ;

Hall, L. ;

Hancock, P. J. B. ;

Hirsch, D. ;

Holt, G. ;

Jackson, J. C. ;

Jong, J. ;

Kehn, A. ;

Koch, C. ;

Kopietz, R. ;

Koerner, U. ;

Kunar, M. A. ;

Lai, C. K. ;

Langton, S. R. H. ;

Leite, F. P. ;

Mammarella, N. ;

Marsh, J. E. ;

McConnaughy, K. A. .

PERSPECTIVES ON PSYCHOLOGICAL SCIENCE, 2014, 9 (05) :556-578

[3] The MTurkification of Social and Personality Psychology [J].

Anderson, Craig A. ;

Allen, Johnie J. ;

Plante, Courtney ;

Quigley-McBride, Adele ;

Lovett, Alison ;

Rokkum, Jeffrey N. .

PERSONALITY AND SOCIAL PSYCHOLOGY BULLETIN, 2019, 45 (06) :842-850

[4] TEST OF SIGNIFICANCE IN PSYCHOLOGICAL RESEARCH [J].

BAKAN, D .

PSYCHOLOGICAL BULLETIN, 1966, 66 (06) :423-&

[5] Selling Ourselves Short? How Abbreviated Measures of Personality Change the Way We Think about Personality and Politics [J].

Bakker, Bert N. ;

Lelkes, Yphtach .

JOURNAL OF POLITICS, 2018, 80 (04) :1311-1325

[6]

Barrett L.F., 2015, The New York Times, pA23

[7] Situated conceptualization offers a theoretical account of social priming [J].

Barsalou, Lawrence W. .

CURRENT OPINION IN PSYCHOLOGY, 2016, 12 :6-11

[8]

Bartlett T., 2018, CHRON HIGHER EDUC, pB6

[9] Redefine statistical significance [J].

Benjamin, Daniel J. ;

Berger, James O. ;

Johannesson, Magnus ;

Nosek, Brian A. ;

Wagenmakers, E. -J. ;

Berk, Richard ;

Bollen, Kenneth A. ;

Brembs, Bjoern ;

Brown, Lawrence ;

Camerer, Colin ;

Cesarini, David ;

Chambers, Christopher D. ;

Clyde, Merlise ;

Cook, Thomas D. ;

De Boeck, Paul ;

Dienes, Zoltan ;

Dreber, Anna ;

Easwaran, Kenny ;

Efferson, Charles ;

Fehr, Ernst ;

Fidler, Fiona ;

Field, Andy P. ;

Forster, Malcolm ;

George, Edward I. ;

Gonzalez, Richard ;

Goodman, Steven ;

Green, Edwin ;

Green, Donald P. ;

Greenwald, Anthony ;

Hadfield, Jarrod D. ;

Hedges, Larry V. ;

Held, Leonhard ;

Ho, Teck Hua ;

Hoijtink, Herbert ;

Hruschka, Daniel J. ;

Imai, Kosuke ;

Imbens, Guido ;

Ioannidis, John P. A. ;

Jeon, Minjeong ;

Jones, James Holland ;

Kirchler, Michael ;

Laibson, David ;

List, John ;

Little, Roderick ;

Lupia, Arthur ;

Machery, Edouard ;

Maxwell, Scott E. ;

McCarthy, Michael ;

Moore, Don ;

Morgan, Stephen L. .

NATURE HUMAN BEHAVIOUR, 2018, 2 (01) :6-10

[10]

Bollen K. A., 1989, Structural equations with latent variables

← 1 2 3 4 5 6 7 8 9 10 →