Understanding experiments and research practices for reproducibility: an exploratory study

被引:22
作者
Samuel, Sheeba [1 ]
Koenig-Ries, Birgitta
机构
[1] Friedrich Schiller Univ Jena, Heinz Nixdorf Chair Distributed Informat Syst, Jena, Germany
来源
PEERJ | 2021年 / 9卷
关键词
Reproducibility; Reproducible research recommendations; Experiments; Reuse; Understandability; Research data lifecycle; Reproducibility crisis; FAIR data principles; SCIENCE; STANDARDS; QUALITY; CRISIS;
D O I
10.7717/peerj.11140
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Scientific experiments and research practices vary across disciplines. The research practices followed by scientists in each domain play an essential role in the understandability and reproducibility of results. The "Reproducibility Crisis'', where researchers find difficulty in reproducing published results, is currently faced by several disciplines. To understand the underlying problem in the context of the reproducibility crisis, it is important to first know the different research practices followed in their domain and the factors that hinder reproducibility. We performed an exploratory study by conducting a survey addressed to researchers representing a range of disciplines to understand scientific experiments and research practices for reproducibility. The survey findings identify a reproducibility crisis and a strong need for sharing data, code, methods, steps, and negative and positive results. Insufficient metadata, lack of publicly available data, and incomplete information in study methods are considered to be the main reasons for poor reproducibility. The survey results also address a wide number of research questions on the reproducibility of scientific results. Based on the results of our explorative study and supported by the existing published literature, we offer general recommendations that could help the scientific community to understand, reproduce, and reuse experimental data and results in the research data lifecycle.
引用
收藏
页数:26
相关论文
共 78 条
[1]  
ACM, 2017, ARTIFACT REV BADGING
[2]  
ACM, 2020, ARTIFACT REV BADGING
[3]   Towards computational reproducibility: researcher perspectives on the use and sharing of software [J].
AlNoamany, Yasmin ;
Borghi, John A. .
PEERJ COMPUTER SCIENCE, 2018,
[4]  
Alston J.M., 2020, B ECOL SOC AM, DOI DOI 10.1002/BES2.1801
[5]  
ANDS Nectar RDS, 2018, **DATA OBJECT**, DOI [10.5281/zenodo.1208136, DOI 10.5281/ZENODO.1208136]
[6]  
[Anonymous], 2018, NATURE, V556, P273, DOI 10.1038/d41586-018-04590-7
[7]  
[Anonymous], 2019, Data Science Journal, V18, DOI DOI 10.5334/DSJ-2019-038
[8]  
[Anonymous], 2019, REPRODUCIBILITY REPL, DOI [10.17226/25303, DOI 10.17226/25303]
[9]  
[Anonymous], 2012, Dublin Core Metadata Initiative (DCMI)Metadata Terms
[10]  
[Anonymous], 2018, P 17 PYTH SCI C, DOI [10.25080/Majora-4af1f417-011, DOI 10.25080/MAJORA-4AF1F417-011]