Computational reproducibility in computational social science

被引:1
作者
Schoch, David [1 ]
Chan, Chung-hong [1 ]
Wagner, Claudia [1 ]
Bleier, Arnim [1 ]
机构
[1] GESIS Leibniz Inst Social Sci, Computat Social Sci Dept, Sachsenhausen 6-8, D-50667 Cologne, NRW, Germany
关键词
Computational Social Science; Open Science; Reproducibility; Replicability Crisis;
D O I
10.1140/epjds/s13688-024-00514-w
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
Open science practices have been widely discussed and have been implemented with varying success in different disciplines. We argue that computational-x disciplines such as computational social science, are also susceptible to the symptoms of the crises, but in terms of reproducibility. We expand the binary definition of reproducibility into a tier system which allows increasing levels of reproducibility based on external verifiability to counteract the practice of open-washing. We provide solutions for barriers in Computational Social Science that hinder researchers from obtaining the highest level of reproducibility, including the use of alternate data sources and considering reproducibility proactively.
引用
收藏
页数:11
相关论文
共 35 条
[11]   Computational social science is growing up: why puberty consists of embracing measurement validation, theory development, and open science practices [J].
Elmer, Timon .
EPJ DATA SCIENCE, 2023, 12 (01)
[12]   Long-term availability of data associated with articles in PLOS ONE [J].
Federer, Lisa M. .
PLOS ONE, 2022, 17 (08)
[13]   Computational Research in the Post-API Age [J].
Freelon, Deen .
POLITICAL COMMUNICATION, 2018, 35 (04) :665-668
[14]  
Grady D.A., 2019, GOLDEN AGE DATA MEDI, V1st ed, DOI [10.4324/9780429276859, DOI 10.4324/9780429276859]
[15]   How Do Scientists Develop and Use Scientific Software? [J].
Hannay, Jo Erskine ;
Langtangen, Hans Petter ;
MacLeod, Carolyn ;
Pfahl, Dietmar ;
Singer, Janice ;
Wilson, Greg .
2009 ICSE WORKSHOP ON SOFTWARE ENGINEERING FOR COMPUTATIONAL SCIENCE AND ENGINEERING, 2009, :1-+
[16]   LITERATE PROGRAMMING [J].
KNUTH, DE .
COMPUTER JOURNAL, 1984, 27 (02) :97-111
[17]   Opening up ChatGPT: Tracking openness, transparency, and accountability in instruction-tuned text generators [J].
Liesenfeld, Andreas ;
Lopez, Alianda ;
Dingemanse, Mark .
PROCEEDINGS OF THE 5TH INTERNATIONAL CONFERENCE ON CONVERSATIONAL USER INTERFACES, CUI 2023, 2023,
[18]  
Metzler K., 2016, Who is doing computational social science? Trends in big data research
[19]  
Morstatter F., 2013, P INT AAAI C WEB SOC, P400, DOI [10.1609/aimag.v39i4.2841, DOI 10.1609/ICWSM.V7I1.14401]
[20]   Digital Trace Data Collection for Social Media Effects Research: APIs, Data Donation, and (Screen) Tracking [J].
Ohme, Jakob ;
Araujo, Theo ;
Boeschoten, Laura ;
Freelon, Deen ;
Ram, Nilam ;
Reeves, Byron B. B. ;
Robinson, Thomas N. .
COMMUNICATION METHODS AND MEASURES, 2024, 18 (02) :124-141