Task Assignment of Peer Grading in MOOCs

被引:1
作者
Han, Yong [1 ]
Wu, Wenjun [1 ]
Pu, Yanjun [1 ]
机构
[1] Beihang Univ, State Key Lab Software Dev Environm, Sch Comp Sci, Beijing, Peoples R China
来源
DATABASE SYSTEMS FOR ADVANCED APPLICATIONS (DASFAA 2017) | 2017年 / 10179卷
关键词
Task assignment; Crowdsourcing; LPT; Peer grading;
D O I
10.1007/978-3-319-55705-2_28
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In a massive online course with hundreds of thousands of students, it is unfeasible to provide an accurate and fast evaluation for each submission. Currently the researchers have proposed the algorithms called peer grading for the richly-structured assignments. These algorithms can deliver fairly accurate evaluations through aggregation of peer grading results, but not improve the effectiveness of allocating submissions. Allocating submissions to peers is an important step before the process of peer grading. In this paper, being inspired from the Longest Processing Time (LPT) algorithm that is often used in the parallel system, we propose a Modified Longest Processing Time (MLPT), which can improve the allocation efficiency. The dataset used in this paper consists of two parts, one part is collected from our MOOCs platform, and the other one is manually generated as the simulation dataset. We have shown the experimental results to validate the effectiveness of MLPT based on the two type datasets.
引用
收藏
页码:352 / 363
页数:12
相关论文
共 21 条
[1]   Scalable Spatial Crowdsourcing: A study of distributed algorithms [J].
Alfarrarjeh, Abdullah ;
Emrich, Tobias ;
Shahabi, Cyrus .
2015 16TH IEEE INTERNATIONAL CONFERENCE ON MOBILE DATA MANAGEMENT, VOL 1, 2015, :134-144
[2]  
[Anonymous], 2013, P 6 ED DAT MIN C
[3]   Towards a Learning Analytics Support for Intelligent Tutoring Systems on MOOC Platforms [J].
Baneres, David ;
Caballe, Santi ;
Clariso, Robert .
PROCEEDINGS OF 2016 10TH INTERNATIONAL CONFERENCE ON COMPLEX, INTELLIGENT, AND SOFTWARE INTENSIVE SYSTEMS (CISIS), 2016, :103-110
[4]   Measuring Crowdsourcing Effort with Error-Time Curves [J].
Cheng, Justin ;
Teevan, Jaime ;
Bernstein, Michael S. .
CHI 2015: PROCEEDINGS OF THE 33RD ANNUAL CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS, 2015, :1365-1374
[5]  
Coffman Jr E.G., 1976, P 1976 ACM SIGMETRIC, P306
[6]  
Feier M. C., 2011, Proceedings 2011 10th International Symposium on Parallel and Distributed Computing (ISPDC 2011), P278, DOI 10.1109/ISPDC.2011.50
[7]  
Fonteles Andr'eSales., 2015, Proceedings of the 13th International Conference on Advances in Mobile Computing and Multimedia, P1
[8]   The Power of d Choices for Redundancy [J].
Gardner, Kristen ;
Zbarsky, Samuel ;
Harchol-Balter, Mor ;
Scheller-Wolf, Alan .
SIGMETRICS/PERFORMANCE 2016: PROCEEDINGS OF THE SIGMETRICS/PERFORMANCE JOINT INTERNATIONAL CONFERENCE ON MEASUREMENT AND MODELING OF COMPUTER SCIENCE, 2016, :409-410
[9]  
Gonzalez T., 1977, SIAM Journal on Computing, V6, P155, DOI 10.1137/0206013
[10]  
Jung H. J., 2013, CROWDSOURCED TASK RO