A Study on Machine Learning for Imbalanced Datasets with Answer Validation of Question Answering

被引:1
|
作者
Day, Min-Yuh [1 ]
Tsai, Cheng-Chia [1 ]
机构
[1] Tamkang Univ, Dept Informat Management, New Taipei, Taiwan
来源
PROCEEDINGS OF 2016 IEEE 17TH INTERNATIONAL CONFERENCE ON INFORMATION REUSE AND INTEGRATION (IEEE IRI) | 2016年
关键词
Answer Validation; Imbalanced Datasets; Machine Learning; Question Answering; QA-Lab; Support Vector Machine;
D O I
10.1109/IRI.2016.76
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Question Answering is a system that can process and answer a given question. In recent years, an enormous number of studies have been made on question answering; little is known about the effects of imbalanced datasets with answer validation of question answer system. The objective of this paper is to provide a better understanding of the effects of imbalanced datasets model for answer validation in a real world university entrance exam question answering system. In this paper, we proposed a question answer system and provided a comprehensive analysis of imbalanced datasets and balanced datasets model with Answer Validation of Question Answering system using NTCIR-12 QA-Lab2 Japanese university entrance exams English translation development and test dataset. As a result, our system achieved 90% accuracy with imbalanced datasets machine learning model for the NTCIR-12 QA-Lab2 development datasets.
引用
收藏
页码:513 / 519
页数:7
相关论文
共 50 条
  • [1] A Scheme of Answer Selection In Community Question Answering Using Machine Learning Techniques
    Wakchaure, Mohini
    Kulkarni, Prakash
    PROCEEDINGS OF THE 2019 INTERNATIONAL CONFERENCE ON INTELLIGENT COMPUTING AND CONTROL SYSTEMS (ICCS), 2019, : 879 - 883
  • [2] Learning Answer Embeddings for Visual Question Answering
    Hu, Hexiang
    Chao, Wei-Lun
    Sha, Fei
    2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 5428 - 5436
  • [3] Collaborative Learning for Answer Selection in Question Answering
    Shao, Taihua
    Kui, Xiaoyan
    Zhang, Pengfei
    Chen, Honghui
    IEEE ACCESS, 2019, 7 : 7337 - 7347
  • [4] Answer type validation in a question-answering system
    Grappy, Arnaud
    Grau, Brigitte
    CORIA 2010: Actes de la COnference en Recherche d'Information et Applications - Proceedings of the Conference on Information Retrieval and Applications, 2010, : 131 - 146
  • [5] Answer Validation for Question Answering Systems by Using External Resources
    Van-Tu Nguyen
    Anh-Cuong Le
    INTEGRATED UNCERTAINTY IN KNOWLEDGE MODELLING AND DECISION MAKING, IUKM 2016, 2016, 9978 : 305 - 316
  • [6] A Hybrid Machine Learning Methodology for Imbalanced Datasets
    Lipitakis, Anastasia-Dimitra
    Kotsiantis, Sotirios
    5TH INTERNATIONAL CONFERENCE ON INFORMATION, INTELLIGENCE, SYSTEMS AND APPLICATIONS, IISA 2014, 2014, : 252 - +
  • [7] Question and Answer Test-Train Overlap in Open-Domain Question Answering Datasets
    Lewis, Patrick
    Stenetorp, Pontus
    Riedel, Sebastian
    16TH CONFERENCE OF THE EUROPEAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (EACL 2021), 2021, : 1000 - 1008
  • [8] The effect of answer validation on the performance of Question-Answering systems
    Rodrigo, Alvaro
    Herrera, Jesus
    Penas, Anselmo
    EXPERT SYSTEMS WITH APPLICATIONS, 2019, 116 : 351 - 363
  • [9] Improving Answer Type Classification Quality Through Combined Question Answering Datasets
    Perevalov, Aleksandr
    Both, Andreas
    KNOWLEDGE SCIENCE, ENGINEERING AND MANAGEMENT, KSEM 2021, PT II, 2021, 12816 : 191 - 204
  • [10] Answer Sequence Learning with Neural Networks for Answer Selection in Community Question Answering
    Zhou, Xiaoqiang
    Hu, Baotian
    Chen, Qingcai
    Tang, Buzhou
    Wang, Xiaolong
    PROCEEDINGS OF THE 53RD ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL) AND THE 7TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING (IJCNLP), VOL 2, 2015, : 713 - 718