BGCFormer: A Text Event Feature Fusion Learning Model based on Transformer

被引:0
|
作者
Liu, Yulong [1 ]
Wang, Juan [1 ]
Li, Qian [1 ]
机构
[1] China Elect Technol Grp Corp, Res Inst 15, Beijing, Peoples R China
来源
2023 8TH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING AND BIG DATA ANALYTICS, ICCCBDA | 2023年
关键词
event extraction; graph convolution networks; deep learning; transformer; information extraction;
D O I
10.1109/ICCCBDA56900.2023.10154819
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Event extraction is an essential task in natural language processing, as it involves extracting meaningful events from text documents, which is important for a variety of applications, such as information retrieval, question answering, and text summarization, yet challenges remain when extracting events from documents, which is that a document usually contain multiple sentences together form a complete event, and entities in the same event may span multiple sentences. To address these challenges, this paper proposes a transformer with features fusion learning model (BGCFormer), which is based on a transformer architecture with GCN and encoder attention mechanism, and it can build a feature fusion learning network to capture global interaction features between different sentences and entity mentions. Experiments conducted on a large-scale dataset have demonstrated the proposed model outperforms existing methods in terms of accuracy and efficiency.
引用
收藏
页码:157 / 161
页数:5
相关论文
共 50 条
  • [21] Sheep Face Recognition Model Based on Deep Learning and Bilinear Feature Fusion
    Wan, Zhuang
    Tian, Fang
    Zhang, Cheng
    ANIMALS, 2023, 13 (12):
  • [22] STEF: a Swin Transformer-Based Enhanced Feature Pyramid Fusion Model for Dongba character detection
    Ma, Yuqi
    Chen, Shanxiong
    Li, Yongbo
    He, Jingliu
    Ruan, Qiuyue
    Xiao, Wenjun
    Xiong, Hailing
    Li, Xiaoliang
    HERITAGE SCIENCE, 2024, 12 (01):
  • [23] DSTM: A transformer-based model with dynamic-static feature fusion in speech emotion recognition
    Jin, Guowei
    Xu, Yunfeng
    Kang, Hong
    Wang, Jialin
    Miao, Borui
    COMPUTER SPEECH AND LANGUAGE, 2025, 90
  • [24] Comparative Analysis of Traditional Machine Learning and Transformer-based Deep Learning Models for Text Classification
    Aydin, Nazif
    Erdem, Osman Ayhan
    Tekerek, Adem
    JOURNAL OF POLYTECHNIC-POLITEKNIK DERGISI, 2025, 28 (02):
  • [25] Text feature extraction based on deep learning: a review
    Hong Liang
    Xiao Sun
    Yunlei Sun
    Yuan Gao
    EURASIP Journal on Wireless Communications and Networking, 2017
  • [26] Multi-focus image fusion based on transformer and depth information learning
    Shao, Xinfeng
    Jin, Xin
    Jiang, Qian
    Miao, Shengfa
    Wang, Puming
    Chu, Xing
    COMPUTERS & ELECTRICAL ENGINEERING, 2024, 119
  • [27] Text feature extraction based on deep learning: a review
    Liang, Hong
    Sun, Xiao
    Sun, Yunlei
    Gao, Yuan
    EURASIP JOURNAL ON WIRELESS COMMUNICATIONS AND NETWORKING, 2017,
  • [28] Seq2Event: Learning the Language of Soccer using Transformer-based Match Event Prediction
    Simpson, Ian
    Beal, Ryan J.
    Locke, Duncan
    Norman, Timothy J.
    PROCEEDINGS OF THE 28TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, KDD 2022, 2022, : 3898 - 3908
  • [29] Math Word Problem Solver Based on Text-to-Text Transformer Model
    Yang, Chuanzhi
    Huang, Runze
    Yu, Xinguo
    Peng, Rao
    IEEE TALE2021: IEEE INTERNATIONAL CONFERENCE ON ENGINEERING, TECHNOLOGY AND EDUCATION, 2021, : 818 - 822
  • [30] Transfer Learning-Based Feature Fusion Model for Classification of Maneuver Weapon Systems
    Hwang, Jinyong
    Choi, You-Rak
    Park, Tae-Jin
    Bae, Ji-Hoon
    JOURNAL OF INFORMATION PROCESSING SYSTEMS, 2023, 19 (05): : 673 - 687