Eliciting Truthful Answers to Multiple-Choice Questions Preliminary Report

被引:0
|
作者
Lambert, Nicolas [1 ]
Shoham, Yoav [1 ]
机构
[1] Stanford Univ, Dept Comp Sci, Stanford, CA 94305 USA
来源
10TH ACM CONFERENCE ON ELECTRONIC COMMERCE - EC 2009 | 2009年
关键词
Multiple-choice questions; elicitation; probability; forecasting;
D O I
暂无
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Motivated by the prevalence of online questionnaires in electronic commerce, and of multiple-choice questions in such questionnaires, we consider the problem of eliciting truthful answers to multiple-choice questions from a knowledgeable respondent. Specifically, each question is a statement regarding an uncertain future event, and is multiple-choice - the responder must select exactly one of the given answers. The principal offers a payment, whose amount is a function of the answer selected and the true outcome (which the principal will eventually observe). Tins problem significantly generalizes recent work on truthful elicitation of distribution properties, which itself generalized a long line of work in elicitation of complete distributions. We provide necessary and sufficient; conditions for the existence of payments that induce truthful answers, and give a characterization of those payments. We also study in greater details the common case of questions with ordinal answers, and illustrate our results with several examples of practical interest.
引用
收藏
页码:109 / 118
页数:10
相关论文
共 50 条
  • [21] RETRACTED: Item Analysis of Multiple-Choice Questions in Teaching Prosthodontics (Retracted Article)
    Madhav, V. N. V.
    JOURNAL OF DENTAL EDUCATION, 2015, 79 (11) : 1314 - 1319
  • [22] CONSTRUCTED RESPONSE OR MULTIPLE-CHOICE QUESTIONS FOR ASSESSING DECLARATIVE PROGRAMMING KNOWLEDGE? THAT IS THE QUESTION!
    Belo, Yolanda
    Moro, Sergio
    Martins, Antonio
    Ramos, Pedro
    Costa, Joana Martinho
    Esmerado, Joaquim
    JOURNAL OF INFORMATION TECHNOLOGY EDUCATION-INNOVATIONS IN PRACTICE, 2019, 18 : 153 - 170
  • [23] The Role of Faculty Development in Improving the Quality of Multiple-Choice Questions in Dental Education
    Shaikh, Saleem
    Kannan, S. Karthiga
    Naqvi, Zuber Ahamed
    Pasha, Zameer
    Ahamad, Mazood
    JOURNAL OF DENTAL EDUCATION, 2020, 84 (03) : 316 - 322
  • [24] Using Automatic Item Generation to Create Multiple-Choice Questions for Pharmacy Assessment
    Leslie, Tara
    Gierl, Mark J.
    AMERICAN JOURNAL OF PHARMACEUTICAL EDUCATION, 2023, 87 (10)
  • [25] Incorporation of Bloom's Taxonomy into Multiple-Choice Examination Questions for a Pharmacotherapeutics Course
    Kim, Myo-Kyoung
    Patel, Rajul A.
    Uchizono, James A.
    Beck, Lynn
    AMERICAN JOURNAL OF PHARMACEUTICAL EDUCATION, 2012, 76 (06)
  • [26] Are multiple-choice questions a good tool for the assessment of clinical competence in Internal Medicine?
    Tangianu, Flavio
    Mazzone, Antonino
    Berti, Franco
    Pinna, Giuliano
    Bortolotti, Irene
    Colombo, Fabrizio
    Nozzoli, Carlo
    La Regina, Micaela
    Greco, Antonio
    Filannino, Cristina
    Silingardi, Mauro
    Nardi, Roberto
    ITALIAN JOURNAL OF MEDICINE, 2018, 12 (02) : 88 - 96
  • [27] An assessment of preclinical removable prosthodontics based on multiple-choice questions: Stakeholders' perceptions
    Shammas, Mohammed
    Nagda, Suhasini
    Shah, Chinmay
    Baxi, Gaurang
    Gadde, Praveen
    Sachdeva, Shabina
    Gupta, Deeksha
    Wali, Othman
    Dhall, Rupinder Singh
    Gajdhar, Shaiq
    JOURNAL OF DENTAL EDUCATION, 2024, 88 (05) : 533 - 543
  • [28] Automatic computer science domain multiple-choice questions generation based on informative sentences
    Maheen F.
    Asif M.
    Ahmad H.
    Ahmad S.
    Alturise F.
    Asiry O.
    Ghadi Y.Y.
    PeerJ Computer Science, 2022, 8
  • [29] ANALYSIS OF MULTIPLE-CHOICE ITEMS
    MOUSSA, MAA
    OUDA, BA
    NEMETH, A
    COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE, 1991, 34 (04) : 283 - 289
  • [30] Categorized and Correlated Multiple-Choice Questions: A Tool for Assessing Comprehensive Physics Knowledge of Students
    Siddiqui, Shabnam
    EDUCATION SCIENCES, 2022, 12 (09):