Eliciting Truthful Answers to Multiple-Choice Questions Preliminary Report

被引:0
作者
Lambert, Nicolas [1 ]
Shoham, Yoav [1 ]
机构
[1] Stanford Univ, Dept Comp Sci, Stanford, CA 94305 USA
来源
10TH ACM CONFERENCE ON ELECTRONIC COMMERCE - EC 2009 | 2009年
关键词
Multiple-choice questions; elicitation; probability; forecasting;
D O I
暂无
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Motivated by the prevalence of online questionnaires in electronic commerce, and of multiple-choice questions in such questionnaires, we consider the problem of eliciting truthful answers to multiple-choice questions from a knowledgeable respondent. Specifically, each question is a statement regarding an uncertain future event, and is multiple-choice - the responder must select exactly one of the given answers. The principal offers a payment, whose amount is a function of the answer selected and the true outcome (which the principal will eventually observe). Tins problem significantly generalizes recent work on truthful elicitation of distribution properties, which itself generalized a long line of work in elicitation of complete distributions. We provide necessary and sufficient; conditions for the existence of payments that induce truthful answers, and give a characterization of those payments. We also study in greater details the common case of questions with ordinal answers, and illustrate our results with several examples of practical interest.
引用
收藏
页码:109 / 118
页数:10
相关论文
共 50 条
  • [31] Medical students create multiple-choice questions for learning in pathology education: a pilot study
    Grainger, Rebecca
    Dai, Wei
    Osborne, Emma
    Kenwright, Diane
    BMC MEDICAL EDUCATION, 2018, 18
  • [32] Categorized and Correlated Multiple-Choice Questions: A Tool for Assessing Comprehensive Physics Knowledge of Students
    Siddiqui, Shabnam
    EDUCATION SCIENCES, 2022, 12 (09):
  • [33] Great Question! The Art and Science of Crafting High-Quality Multiple-Choice Questions
    Catanzano, Tara
    Jordan, Sheryl G.
    Lewis, Petra J.
    JOURNAL OF THE AMERICAN COLLEGE OF RADIOLOGY, 2022, 19 (06) : 687 - 692
  • [34] Feedback, fairness, and validity: effects of disclosing and reusing multiple-choice questions in medical schools
    Appelhaus, Stefan
    Werner, Susanne
    Grosse, Pascal
    Kaemmer, Juliane E.
    MEDICAL EDUCATION ONLINE, 2023, 28 (01):
  • [35] A Participatory Learning Approach to Biochemistry Using Student Authored and Evaluated Multiple-choice Questions
    Bottomley, Steven
    Denny, Paul
    BIOCHEMISTRY AND MOLECULAR BIOLOGY EDUCATION, 2011, 39 (05) : 352 - 361
  • [36] Unfolding the Drivers of Student Success in Answering Multiple-Choice Questions About Microsoft Excel
    Moro, Sergio
    Martins, Antonio
    Ramos, Pedro
    Esmerado, Joaquim
    Costa, Joana Martinho
    Almeida, Daniela
    COMPUTERS IN THE SCHOOLS, 2020, 37 (02) : 55 - 73
  • [37] Assessing the Benefit of Student Self-Generated Multiple-Choice Questions on Examination Performance
    Geiger, Marshall A.
    Middleton, Mary M.
    Tahseen, Maryam
    ISSUES IN ACCOUNTING EDUCATION, 2021, 36 (02): : 1 - 20
  • [38] Automatic computer science domain multiple-choice questions generation based on informative sentences
    Maheen, Farah
    Asif, Muhammad
    Ahmad, Haseeb
    Ahmad, Shahbaz
    Alturise, Fahad
    Asiry, Othman
    Ghadi, Yazeed Yasin
    PEERJ COMPUTER SCIENCE, 2022, 8
  • [39] Does developing multiple-choice Questions Improve Medical Students' Learning? A Systematic Review
    Touissi, Youness
    Hjiej, Ghita
    Hajjioui, Abderrazak
    Ibrahimi, Azeddine
    Fourtassi, Maryam
    MEDICAL EDUCATION ONLINE, 2022, 27 (01):
  • [40] Information Quality in The Analysis of Multiple-Choice Questions on An Example of Assessing the Importance of The European Union
    Stanimir, Agnieszka
    EDUCATION EXCELLENCE AND INNOVATION MANAGEMENT: A 2025 VISION TO SUSTAIN ECONOMIC DEVELOPMENT DURING GLOBAL CHALLENGES, 2020, : 1410 - 1428