Eliciting Truthful Answers to Multiple-Choice Questions Preliminary Report

被引:0
|
作者
Lambert, Nicolas [1 ]
Shoham, Yoav [1 ]
机构
[1] Stanford Univ, Dept Comp Sci, Stanford, CA 94305 USA
来源
10TH ACM CONFERENCE ON ELECTRONIC COMMERCE - EC 2009 | 2009年
关键词
Multiple-choice questions; elicitation; probability; forecasting;
D O I
暂无
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Motivated by the prevalence of online questionnaires in electronic commerce, and of multiple-choice questions in such questionnaires, we consider the problem of eliciting truthful answers to multiple-choice questions from a knowledgeable respondent. Specifically, each question is a statement regarding an uncertain future event, and is multiple-choice - the responder must select exactly one of the given answers. The principal offers a payment, whose amount is a function of the answer selected and the true outcome (which the principal will eventually observe). Tins problem significantly generalizes recent work on truthful elicitation of distribution properties, which itself generalized a long line of work in elicitation of complete distributions. We provide necessary and sufficient; conditions for the existence of payments that induce truthful answers, and give a characterization of those payments. We also study in greater details the common case of questions with ordinal answers, and illustrate our results with several examples of practical interest.
引用
收藏
页码:109 / 118
页数:10
相关论文
共 50 条
  • [1] Automated Assessment with Multiple-choice Questions using Weighted Answers
    Zampirolli, Francisco de Assis
    Batista, Valerio Ramos
    Rodriguez, Carla
    da Rocha, Rafaela Vilela
    Goya, Denise
    CSEDU: PROCEEDINGS OF THE 13TH INTERNATIONAL CONFERENCE ON COMPUTER SUPPORTED EDUCATION - VOL 1, 2021, : 254 - 261
  • [2] Quality assessment of multiple-choice questions
    Akram, Zareena
    Aman, Khaliq
    Waheed, Nomira
    Rahim, Shiekh Kashif
    Hanif, Fouzia
    Abdullah, Zainab
    RAWAL MEDICAL JOURNAL, 2025, 50 (01): : 191 - 194
  • [3] Generating Adequate Distractors for Multiple-Choice Questions
    Zhang, Cheng
    Sun, Yicheng
    Chen, Hejia
    Wang, Jie
    PROCEEDINGS OF THE 12TH INTERNATIONAL JOINT CONFERENCE ON KNOWLEDGE DISCOVERY, KNOWLEDGE ENGINEERING AND KNOWLEDGE MANAGEMENT (KDIR), VOL 1, 2020, : 310 - 315
  • [4] Effect of faculty training on quality of multiple-choice questions
    Gupta, Piyush
    Meena, Pinky
    Khan, Amir Maroof
    Malhotra, Rajeev Kumar
    Singh, Tejinder
    INTERNATIONAL JOURNAL OF APPLIED AND BASIC MEDICAL RESEARCH, 2020, 10 (03) : 210 - 214
  • [5] Assessment of Global Health Education: The Role of Multiple-Choice Questions
    Douthit, Nathan T.
    Norcini, John
    Mazuz, Keren
    Alkan, Michael
    Feuerstein, Marie-Therese
    Clarfield, A. Mark
    Dwolatzky, Tzvi
    Solomonov, Evgeny
    Waksman, Igor
    Biswas, Seema
    FRONTIERS IN PUBLIC HEALTH, 2021, 9
  • [6] The impact of a faculty development seminar on the quality of multiple-choice questions
    Nemec, Eric C.
    Welch, Beth
    CURRENTS IN PHARMACY TEACHING AND LEARNING, 2016, 8 (02) : 160 - 163
  • [7] MULTIPLE-CHOICE QUESTIONS IN EDUCATIONAL RESEARCH: CODING, TABULATION AND ANALYSIS
    Serrano Angulo, Jose
    RIE-REVISTA DE INVESTIGACION EDUCATIVA, 2013, 31 (02): : 361 - 374
  • [8] Test-Wiseness and Multiple-Choice Accounting Questions: Implications for Instructors
    Bailey, Charles D.
    Briggs, John W.
    Irving, James H.
    ISSUES IN ACCOUNTING EDUCATION, 2022, 37 (02): : 1 - 14
  • [9] Automatic distractor generation in multiple-choice questions: a systematic literature review
    Awalurahman, Halim Wildan
    Budi, Indra
    PEERJ COMPUTER SCIENCE, 2024, 10
  • [10] Pattern recognition as a concept for multiple-choice questions in a national licensing exam
    Freiwald, Tilo
    Salimi, Madjid
    Khaljani, Ehsan
    Harendza, Sigrid
    BMC MEDICAL EDUCATION, 2014, 14