Joint Learning of Question Answering and Question Generation

被引:21
|
作者
Sun, Yibo [1 ]
Tang, Duyu [2 ]
Duan, Nan [2 ]
Qin, Tao [2 ]
Liu, Shujie [2 ]
Yan, Zhao [2 ]
Zhou, Ming [2 ]
Lv, Yuanhua [3 ]
Yin, Wenpeng [4 ]
Feng, Xiaocheng [1 ]
Qin, Bing [1 ]
Liu, Ting [1 ]
机构
[1] Harbin Inst Technol, Dept Comp Sci, Haerbin 150006, Heilongjiang, Peoples R China
[2] Microsoft Res Asia, Beijing 100080, Peoples R China
[3] Microsoft AI & Res, Sunnyvale, CA 94089 USA
[4] Univ Penn, Philadelphia, PA 19104 USA
基金
中国国家自然科学基金;
关键词
Task analysis; Training; Mathematical model; Knowledge discovery; Data models; Computational modeling; Collaboration; Question answering; question generation;
D O I
10.1109/TKDE.2019.2897773
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Question answering (QA) and question generation (QG) are closely related tasks that could improve each other; however, the connection of these two tasks is not well explored in the literature. In this paper, we present two training algorithms for learning better QA and QG models through leveraging one another. The first algorithm extends Generative Adversarial Network (GAN), which selectively incorporates artificially generated instances as additional QA training data. The second algorithm is an extension of dual learning, which incorporates the probabilistic correlation of QA and QG as additional regularization in training objectives. To test the scalability of our algorithms, we conduct experiments on both document based and table based question answering tasks. Results show that both algorithms improve a QA model in terms of accuracy and QG model in terms of BLEU score. Moreover, we find that the performance of a QG model could be easily improved by a QA model via policy gradient, however, directly applying GAN that regards all the generated questions as negative instances could not improve the accuracy of the QA model. Our algorithm that selectively assigns labels to generated questions would bring a performance boost.
引用
收藏
页码:971 / 982
页数:12
相关论文
共 50 条
  • [1] Joint Learning of Answer Selection and Answer Summary Generation in Community Question Answering
    Deng, Yang
    Lam, Wai
    Xie, Yuexiang
    Chen, Daoyuan
    Li, Yaliang
    Yang, Min
    Shen, Ying
    THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 7651 - 7658
  • [2] Design of Question Answering System with Automated Question Generation
    Kim, Min-kyoung
    Kim, Han-joon
    NCM 2008: 4TH INTERNATIONAL CONFERENCE ON NETWORKED COMPUTING AND ADVANCED INFORMATION MANAGEMENT, VOL 2, PROCEEDINGS, 2008, : 365 - 368
  • [3] Multi-Question Learning for Visual Question Answering
    Lei, Chenyi
    Wu, Lei
    Liu, Dong
    Li, Zhao
    Wang, Guoxin
    Tang, Haihong
    Li, Houqiang
    THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 11328 - 11335
  • [4] Learning to Rank for Question Routing in Community Question Answering
    Ji, Zongcheng
    Wang, Bin
    PROCEEDINGS OF THE 22ND ACM INTERNATIONAL CONFERENCE ON INFORMATION & KNOWLEDGE MANAGEMENT (CIKM'13), 2013, : 2363 - 2368
  • [5] QUESTION ANSWERING AND LEARNING WITH HYPERTEXT
    ROUET, JF
    LESSONS FROM LEARNING, 1994, 46 : 39 - 52
  • [6] Unsupervised Multi-hop Question Answering by Question Generation
    Pan, Liangming
    Chen, Wenhu
    Xiong, Wenhan
    Kan, Min-Yen
    Wang, William Yang
    2021 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES (NAACL-HLT 2021), 2021, : 5866 - 5880
  • [7] Visual Question Generation as Dual Task of Visual Question Answering
    Li, Yikang
    Duan, Nan
    Zhou, Bolei
    Chu, Xiao
    Ouyang, Wanli
    Wang, Xiaogang
    Zhou, Ming
    2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 6116 - 6124
  • [8] Consistency Training by Synthetic Question Generation for Conversational Question Answering
    Hemati, Hamed Hematian
    Beigy, Hamid
    PROCEEDINGS OF THE 62ND ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, VOL 2: SHORT PAPERS, 2024, : 630 - 639
  • [9] Automated question generation and question answering from Turkish texts
    Akyon, Fatih Cagatay
    Cavusoglu, Devrim
    Cengiz, Cemil
    Altinuc, Sinan Onur
    Temizel, Alptekin
    TURKISH JOURNAL OF ELECTRICAL ENGINEERING AND COMPUTER SCIENCES, 2022, 30 (05) : 1931 - +
  • [10] Event Extraction as Question Generation and Answering
    Lu, Di
    Ran, Shihao
    Tetreault, Joel
    Jaimes, Alejandro
    61ST CONFERENCE OF THE THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, ACL 2023, VOL 2, 2023, : 1666 - 1688