Eliciting Truthful Answers to Multiple-Choice Questions Preliminary Report

被引:0
作者
Lambert, Nicolas [1 ]
Shoham, Yoav [1 ]
机构
[1] Stanford Univ, Dept Comp Sci, Stanford, CA 94305 USA
来源
10TH ACM CONFERENCE ON ELECTRONIC COMMERCE - EC 2009 | 2009年
关键词
Multiple-choice questions; elicitation; probability; forecasting;
D O I
暂无
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Motivated by the prevalence of online questionnaires in electronic commerce, and of multiple-choice questions in such questionnaires, we consider the problem of eliciting truthful answers to multiple-choice questions from a knowledgeable respondent. Specifically, each question is a statement regarding an uncertain future event, and is multiple-choice - the responder must select exactly one of the given answers. The principal offers a payment, whose amount is a function of the answer selected and the true outcome (which the principal will eventually observe). Tins problem significantly generalizes recent work on truthful elicitation of distribution properties, which itself generalized a long line of work in elicitation of complete distributions. We provide necessary and sufficient; conditions for the existence of payments that induce truthful answers, and give a characterization of those payments. We also study in greater details the common case of questions with ordinal answers, and illustrate our results with several examples of practical interest.
引用
收藏
页码:109 / 118
页数:10
相关论文
共 50 条
  • [41] Medical students create multiple-choice questions for learning in pathology education: a pilot study
    Rebecca Grainger
    Wei Dai
    Emma Osborne
    Diane Kenwright
    BMC Medical Education, 18
  • [42] Weighted Scoring of Multiple-choice Questions based Exams: Expert and Empirical Weighting Factors
    Photopoulos, Panagiotis
    Tsakiridis, Odysseus
    Stavrakas, Ilias
    Triantis, Dimos
    PROCEEDINGS OF THE 12TH INTERNATIONAL CONFERENCE ON COMPUTER SUPPORTED EDUCATION (CSEDU), VOL 1, 2020, : 382 - 387
  • [43] Student-generated Multiple-Choice Questions: A Java']Java and Web-Based Tool for Students to Create Multiple Choice Tests
    Katz, Larry
    Carlgren, Dave
    Wright-Maley, Cory
    Hallam, Megan
    Forder, Joan
    Milner, Danielle
    Finestone, Lisa
    CANADIAN JOURNAL FOR THE SCHOLARSHIP OF TEACHING AND LEARNING, 2024, 15 (02):
  • [44] ChatGPT's ability or prompt quality: what determines the success of generating multiple-choice questions
    Kiyak, Yavuz Selim
    ACADEMIC PATHOLOGY, 2024, 11 (02):
  • [45] ChatGPT prompts for generating multiple-choice questions in medical education and evidence on their validity: a literature review
    Kiyak, Yavuz Selim
    Emekli, Emre
    POSTGRADUATE MEDICAL JOURNAL, 2024, 100 (1189) : 858 - 865
  • [46] The frequency of item writing flaws in multiple-choice questions used in high stakes nursing assessments
    Tarrant, Marie
    Knierim, Aimee
    Hayes, Sasha K.
    Ware, James
    NURSE EDUCATION TODAY, 2006, 26 (08) : 662 - 671
  • [47] Large Language Models as Tools to Generate Radiology Board-Style Multiple-Choice Questions
    Mistry, Neel P.
    Saeed, Huzaifa
    Rafique, Sidra
    Le, Thuy
    Obaid, Haron
    Adams, Scott J.
    ACADEMIC RADIOLOGY, 2024, 31 (09) : 3872 - 3878
  • [48] Structure of text and multiple-choice questions in continuing medical education (CME) in two specialist journals
    Nobbe, Helmut
    Loesche, Peter
    Griebenow, Reinhard
    MEDIZINISCHE KLINIK, 2008, 103 (01) : 14 - 19
  • [49] The Value of Choice: An Experiment Using Multiple-Choice Tests
    Aray, Henry
    Pedauga, Luis
    EDUCATIONAL MEASUREMENT-ISSUES AND PRACTICE, 2019, 38 (03) : 20 - 32
  • [50] CONSEQUENCES THE EXTENSIVE USE OF MULTIPLE-CHOICE QUESTIONS MIGHT HAVE ON STUDENT'S REASONING STRUCTURE
    Raduta, C. M.
    ROMANIAN JOURNAL OF PHYSICS, 2013, 58 (9-10): : 1363 - 1380