Empirica: a virtual lab for high-throughput macro-level experiments

被引:0
作者
Abdullah Almaatouq
Joshua Becker
James P. Houghton
Nicolas Paton
Duncan J. Watts
Mark E. Whiting
机构
[1] Massachusetts Institute of Technology,
[2] University College London,undefined
[3] University of Pennsylvania,undefined
来源
Behavior Research Methods | 2021年 / 53卷
关键词
Virtual lab; Online research; Crowdsourcing;
D O I
暂无
中图分类号
学科分类号
摘要
Virtual labs allow researchers to design high-throughput and macro-level experiments that are not feasible in traditional in-person physical lab settings. Despite the increasing popularity of online research, researchers still face many technical and logistical barriers when designing and deploying virtual lab experiments. While several platforms exist to facilitate the development of virtual lab experiments, they typically present researchers with a stark trade-off between usability and functionality. We introduce Empirica: a modular virtual lab that offers a solution to the usability–functionality trade-off by employing a “flexible defaults” design strategy. This strategy enables us to maintain complete “build anything” flexibility while offering a development platform that is accessible to novice programmers. Empirica’s architecture is designed to allow for parameterizable experimental designs, reusable protocols, and rapid development. These features will increase the accessibility of virtual lab experiments, remove barriers to innovation in experiment design, and enable rapid progress in the understanding of human behavior.
引用
收藏
页码:2158 / 2171
页数:13
相关论文
共 116 条
  • [1] Agrawal M(2020)Scaling up psychology via scientific regret minimization Proceedings of the National Academy of Sciences 117 8825-8835
  • [2] Peterson JC(2020)Adaptive social networks promote the wisdom of crowds Proceedings of the National Academy of Sciences 117 11379-11386
  • [3] Griffiths TL(2020)Gorilla in our midst: an online behavioral experiment builder Behavior Research Methods 52 388-407
  • [4] Almaatouq A(2018)Conducting interactive experiments online Experimental Economics 21 99-131
  • [5] Noriega-Campero A(2018)The moral machine experiment Nature 563 59-64
  • [6] Alotaibi A(2017)nodegame: Real-time, synchronous, online experiments in the browser Behavior Research Methods 49 1696-1715
  • [7] Krafft PM(2017)Network dynamics of social influence in the wisdom of crowds Proceedings of the National Academy of Sciences 114 E5070-E5076
  • [8] Moussaid M(2019)The crowd classification problem Academy of Management Proceedings 2019 13404-10722
  • [9] Pentland A(2019)The wisdom of partisan crowds Proceedings of the National Academy of Sciences 116 10717-368
  • [10] Anwyl-Irvine AL(2012)Evaluating online labor markets for experimental research: Amazon Mechanical Turk Political Analysis 20 351-832