Crowdsourcing contest dilemma

被引:15
作者
Naroditskiy, Victor [1 ]
Jennings, Nicholas R. [1 ,2 ]
Van Hentenryck, Pascal [3 ]
Cebrian, Manuel [3 ]
机构
[1] Univ Southampton, Sch Elect & Comp Sci, Southampton SO17 1BJ, Hants, England
[2] King Abdulaziz Univ, Dept Comp & Informat Technol, Jeddah, Saudi Arabia
[3] Natl Informat & Commun Technol Australia, Melbourne, Vic 3003, Australia
基金
美国国家科学基金会; 英国工程与自然科学研究理事会;
关键词
crowdsourcing; game theory; Prisoner's Dilemma; EVOLUTION; GAMES;
D O I
10.1098/rsif.2014.0532
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Crowdsourcing offers unprecedented potential for solving tasks efficiently by tapping into the skills of large groups of people. A salient feature of crowdsourcing-its openness of entry-makes it vulnerable to malicious behaviour. Such behaviour took place in a number of recent popular crowdsourcing competitions. We provide game-theoretic analysis of a fundamental trade-off between the potential for increased productivity and the possibility of being set back by malicious behaviour. Our results show that in crowdsourcing competitions malicious behaviour is the norm, not the anomaly-a result contrary to the conventional wisdom in the area. Counter-intuitively, making the attacks more costly does not deter them but leads to a less desirable outcome. These findings have cautionary implications for the design of crowdsourcing competitions.
引用
收藏
页数:8
相关论文
共 59 条
[21]   Using selection bias to explain the observed structure of Internet diffusions [J].
Golub, Benjamin ;
Jackson, Matthew O. .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2010, 107 (24) :10833-10836
[22]  
Goyal S, 2012, STOC'12: PROCEEDINGS OF THE 2012 ACM SYMPOSIUM ON THEORY OF COMPUTING, P759
[23]   Engineer set to run NSF [J].
Hand, Eric .
NATURE, 2010, 465 (7299) :673-673
[24]   Searching for Jim Gray: A Technical Overview [J].
Hellerstein, Joseph M. ;
Tennenhouse, David L. .
COMMUNICATIONS OF THE ACM, 2011, 54 (07) :77-87
[25]  
Horowitz D., 2010, Proceedings of the 19th international conference on World wide web, WWW '10, P431
[26]  
Howe J., 2006, Wired Mag, V6, P1
[27]   Crowdsourcing, attention and productivity [J].
Huberman, Bernardo A. ;
Romero, Daniel M. ;
Wu, Fang .
JOURNAL OF INFORMATION SCIENCE, 2009, 35 (06) :758-765
[28]  
Ipeirotis Panos., 2011, P 8 INT WORKSHOP INF, P1
[29]  
Ipeirotis PG, 2011, P 20 INT C COMP WORL, P287, DOI DOI 10.1145/1963192.1963314
[30]  
Kamar E., 2012, Proceedings of the 11th international conference on autonomous agents and multiagent systems, P1329