The Garbage Can Model: A Study in (Non)Reproducible Research

被引:0
作者
Levin, Stewart A. [1 ]
机构
[1] Stanford Univ, Stanford, CA 94305 USA
关键词
computational modeling; organizational behavior; reproducibility;
D O I
暂无
中图分类号
O1 [数学]; C [社会科学总论];
学科分类号
03 ; 0303 ; 0701 ; 070101 ;
摘要
The classic paper "A Garbage Can Model of Organizational Choice" by Cohen, March and Olsen (1972) both heralded a significant expansion of the study of organizational decision making to non-industrial settings, in particular universities, and served as a very early example of reproducible computational research, incorporating a Fortran 66 program in its appendix to permit others to reproduce their results and run further examples. In this work my extensive attempts to perfectly reproduce the original results show the inherent challenge of reproducing computational research in the presence of ever-changing computing platforms and technology. Indeed, exact values could not be reproduced in this study, nor any other published study, because of hypersensitivity. Despite this, additional statistics allowed by modern computer capabilities almost completely agree with the qualitative observations and conclusions in the original work. Finally, in light of the need for high precision, it will be worthwhile to retest and reevaluate later studies of the internal dynamics of the model that faulted the code for behavior at odds with the theory.
引用
收藏
页码:455 / 465
页数:11
相关论文
共 50 条
[41]   Reproducible Research for Scientific Computing: Tools and Strategies for Changing the Culture [J].
LeVeque, Randall J. ;
Mitchell, Ian M. ;
Stodden, Victoria .
COMPUTING IN SCIENCE & ENGINEERING, 2012, 14 (04) :13-17
[42]   On Reproducible Implementations in Unsupervised Concept Drift Detection Algorithms Research [J].
Lukats, Daniel ;
Stahl, Frederic .
ARTIFICIAL INTELLIGENCE XL, AI 2023, 2023, 14381 :204-209
[43]   Teaching reproducible research for medical students and postgraduate pharmaceutical scientists [J].
Andreas D. Meid .
BMC Research Notes, 14
[44]   Science Forum: Is preclinical research in cancer biology reproducible enough? [J].
Kane, Patrick Bodilly ;
Kimmelman, Jonathan .
ELIFE, 2021, 10
[45]   Tooling for Reproducible Research: Considerations for the Past and Future of Data Analysis [J].
Peng, Roger D. .
AUSTRIAN JOURNAL OF STATISTICS, 2025, 54 (03) :1-8
[46]   Prediction scoring of data-driven discoveries for reproducible research [J].
Smith, Anna L. ;
Zheng, Tian ;
Gelman, Andrew .
STATISTICS AND COMPUTING, 2023, 33 (01)
[47]   Teaching reproducible research for medical students and postgraduate pharmaceutical scientists [J].
Meid, Andreas D. .
BMC RESEARCH NOTES, 2021, 14 (01)
[48]   PEGR: a flexible management platform for reproducible epigenomic and genomic research [J].
Danying Shao ;
Gretta D. Kellogg ;
Ali Nematbakhsh ;
Prashant K. Kuntala ;
Shaun Mahony ;
B. Franklin Pugh ;
William K. M. Lai .
Genome Biology, 23
[49]   HOW TO MAKE A PIE: REPRODUCIBLE RESEARCH FOR EMPIRICAL ECONOMICS AND ECONOMETRICS [J].
Orozco, Valerie ;
Bontemps, Christophe ;
Maigne, Elise ;
Piguet, Virginie ;
Hofstetter, Annie ;
Lacroix, Anne ;
Levert, Fabrice ;
Rousselle, Jean-Marc .
JOURNAL OF ECONOMIC SURVEYS, 2020, 34 (05) :1134-1169
[50]   PEGR: a flexible management platform for reproducible epigenomic and genomic research [J].
Shao, Danying ;
Kellogg, Gretta D. ;
Nematbakhsh, Ali ;
Kuntala, Prashant K. ;
Mahony, Shaun ;
Pugh, B. Franklin ;
Lai, William K. M. .
GENOME BIOLOGY, 2022, 23 (01)