Event co-occurrences for prompt-based generative event argument extraction

被引:0
|
作者
Peng, Jiaren [1 ,2 ]
Yang, Wenzhong [1 ,2 ]
Wei, Fuyuan [1 ,2 ]
He, Liang [1 ,3 ]
Yao, Long [1 ,2 ]
Lv, Hongzhen [1 ,2 ]
机构
[1] Xinjiang Univ, Sch Comp Sci & Technol, Sch Cyberspace Secur, Urumqi 830046, Peoples R China
[2] Xinjiang Univ, Xinjiang Key Lab Multilingual Informat Technol, Urumqi 830046, Peoples R China
[3] Tsinghua Univ, Dept Elect Engn, Beijing 100084, Peoples R China
来源
SCIENTIFIC REPORTS | 2024年 / 14卷 / 01期
基金
中国国家自然科学基金;
关键词
D O I
10.1038/s41598-024-82883-w
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Recent works have introduced prompt learning for Event Argument Extraction (EAE) since prompt-based approaches transform downstream tasks into a more consistent format with the training task of Pre-trained Language Model (PLM). This helps bridge the gap between downstream tasks and model training. However, these previous works overlooked the complex number of events and their relationships within sentences. In order to address this issue, we propose Event Co-occurrences Prefix Event Argument Extraction (ECPEAE). ECPEAE utilizes the co-occurrences events prefixes module to incorporate template information corresponding to all events present in the current input as prefixes. These co-occurring event knowledge assist the model in handling complex event relationships. Additionally, to emphasize the template corresponding to the current event being extracted and enhance its constraint on the output format, we employ the present event bias module to integrate the template information into the calculation of attention at each layer of the model. Furthermore, we introduce an adjustable copy mechanism to overcome potential noise introduced by the additional information in the attention calculation at each layer. We validate our model using two widely used EAE datasets, ACE2005-EN and ERE-EN. Experimental results demonstrate that our ECPEAE model achieves state-of-the-art performance on both the ACE2005-EN dataset and the ERE dataset. Additionally, according to the results, our model also can be adapted to the low resource environment of different training sizes effectively.
引用
收藏
页数:17
相关论文
共 50 条
  • [1] Revisiting Event Argument Extraction: Can EAE Models Learn Better When Being Aware of Event Co-occurrences?
    He, Yuxin
    Hu, Jingyue
    Tang, Buzhou
    PROCEEDINGS OF THE 61ST ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2023): LONG PAPERS, VOL 1, 2023, : 12542 - 12556
  • [2] CorefPrompt: Prompt-based Event Coreference Resolution by Measuring Event Type and Argument Compatibilities
    Xu, Sheng
    Li, Peifeng
    Zhu, Qiaoming
    2023 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2023), 2023, : 15440 - 15452
  • [3] Prompt-Based Event Temporal Relation Extraction with Contrastive Learning
    Chen, You
    Wang, Tao
    Cheng, Lianglun
    Chen, Chong
    ADVANCED INTELLIGENT COMPUTING TECHNOLOGY AND APPLICATIONS, PT IV, ICIC 2024, 2024, 14865 : 186 - 198
  • [4] Prompt for Extraction? PAIE: Prompting Argument Interaction for Event Argument Extraction
    Ma, Yubo
    Wang, Zehao
    Cao, Yixin
    Li, Mukai
    Chen, Meiqi
    Wang, Kun
    Shao, Jing
    PROCEEDINGS OF THE 60TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2022), VOL 1: (LONG PAPERS), 2022, : 6759 - 6774
  • [5] Discovery of Entailment Relations from Event Co-Occurrences
    Pekar, Viktor
    ECAI 2006, PROCEEDINGS, 2006, 141 : 516 - 520
  • [6] Studying the Temporal Dynamics of Word Co-Occurrences: An Application to Event Detection
    Preotiuc-Pietro, Daniel
    Srijith, P. K.
    Hepple, Mark
    Cohn, Trevor
    LREC 2016 - TENTH INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION, 2016, : 4380 - 4387
  • [7] Prompt Debiasing via Causal Intervention for Event Argument Extraction
    Lin, Jiaju
    Zhou, Jie
    Chen, Qin
    NATURAL LANGUAGE PROCESSING AND CHINESE COMPUTING, PT II, NLPCC 2024, 2025, 15360 : 96 - 108
  • [8] Prompt-based event relation identification with Constrained Prefix ATTention mechanism
    Zhang, Hang
    Ke, Wenjun
    Zhang, Jianwei
    Luo, Zhizhao
    Ma, Hewen
    Luan, Zhen
    Wang, Peng
    KNOWLEDGE-BASED SYSTEMS, 2023, 281
  • [9] Context-Aware Prompt for Generation-based Event Argument Extraction with Diffusion Models
    Luo, Lei
    Xu, Yajing
    PROCEEDINGS OF THE 32ND ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, CIKM 2023, 2023, : 1717 - 1725
  • [10] Using Reverse Lookup and Bidirectional Query for Event Argument Extraction Prompt Enhancement
    Zheng, Yifeng
    Li, Shengyang
    Hao, Shiyi
    Wang, Linjie
    Wang, Chen
    Liu, Yunfei
    2024 7TH INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND BIG DATA, ICAIBD 2024, 2024, : 199 - 205