CrowdAdvisor: A Framework for Freelancer Assessment in Online Marketplace

被引:14
作者
Abhinav, Kumar [1 ]
Dubey, Alpana [1 ]
Jain, Sakshi [1 ]
Virdi, Gurdeep [1 ]
Kass, Alex [2 ]
Mehta, Manish [2 ]
机构
[1] Accenture Labs, Bangalore, Karnataka, India
[2] Accenture Labs, San Jose, CA USA
来源
2017 IEEE/ACM 39TH INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING: SOFTWARE ENGINEERING IN PRACTICE TRACK (ICSE-SEIP 2017) | 2017年
关键词
D O I
10.1109/ICSE-SEIP.2017.23
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Hiring is one of the important challenges in the context of online labor marketplace. Unlike traditional hiring, where workers are hired either as a full time employee or as a contractor, hiring from online marketplaces are done for individual jobs of short duration. As these marketplaces are open for anyone, hiring becomes challenging due to the large number of freelancers applying for a posted job. Quite often, clients use ratings of the freelancers while hiring. However, we have observed that ratings are skewed towards higher values and do not provide valuable insights about freelancers' abilities to do a quality work. Therefore, we propose a multidimensional assessment framework which evaluates freelancers on several dimensions. The proposed framework, not only uses the current information about the freelancer, but also utilizes the past jobs he has performed. The framework is evaluated on the data collected from a popular online marketplace. Our analysis, performed on 7254 jobs and 96,271 applicants, shows that the assessment made by the proposed framework outperforms the baseline algorithm.
引用
收藏
页码:93 / 102
页数:10
相关论文
共 28 条
[1]  
Agrawal Ajay K, 2013, W18720 NAT BUR EC RE
[2]  
Ambati V., 2011, HUMAN COMPUTATION, P1
[3]  
[Anonymous], 2013, COMPUTER MEDIATED MA
[4]  
Baeza-Yates R, 1999, MODERN INFORM RETRIE, V463
[5]  
Barach M.A., 2015, Search, Screening, and Information Provision: Personnel Decisions in an Online Labor Market
[6]   SMOTE: Synthetic minority over-sampling technique [J].
Chawla, Nitesh V. ;
Bowyer, Kevin W. ;
Hall, Lawrence O. ;
Kegelmeyer, W. Philip .
2002, American Association for Artificial Intelligence (16)
[7]  
Che Dunren, 2016, APPL COMPUTING INFOR
[8]  
Chilton L. B., 2010, P ACM SIGKDD WORKSH, P1, DOI DOI 10.1145/1837885.1837889
[9]  
Ching Man-, 2011, INT THINGS ITHINGS C
[10]  
Difallah D.E., 2013, P 22 WWW INT C RIO D