BGCFormer: A Text Event Feature Fusion Learning Model based on Transformer

被引:0
|
作者
Liu, Yulong [1 ]
Wang, Juan [1 ]
Li, Qian [1 ]
机构
[1] China Elect Technol Grp Corp, Res Inst 15, Beijing, Peoples R China
来源
2023 8TH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING AND BIG DATA ANALYTICS, ICCCBDA | 2023年
关键词
event extraction; graph convolution networks; deep learning; transformer; information extraction;
D O I
10.1109/ICCCBDA56900.2023.10154819
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Event extraction is an essential task in natural language processing, as it involves extracting meaningful events from text documents, which is important for a variety of applications, such as information retrieval, question answering, and text summarization, yet challenges remain when extracting events from documents, which is that a document usually contain multiple sentences together form a complete event, and entities in the same event may span multiple sentences. To address these challenges, this paper proposes a transformer with features fusion learning model (BGCFormer), which is based on a transformer architecture with GCN and encoder attention mechanism, and it can build a feature fusion learning network to capture global interaction features between different sentences and entity mentions. Experiments conducted on a large-scale dataset have demonstrated the proposed model outperforms existing methods in terms of accuracy and efficiency.
引用
收藏
页码:157 / 161
页数:5
相关论文
共 50 条
  • [41] A Transformer-Based Network With Feature Complementary Fusion for Crack Defect Detection
    Ma, Mingyang
    Yang, Lei
    Liu, Yanhong
    Yu, Hongnian
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2024, 25 (11) : 16989 - 17006
  • [42] Fault Diagnosis for the Power Transformer Based on Multi-feature Fusion algorithm
    Liu, Chenfei
    Cui, Haoyang
    Li, Gaofang
    PROCEEDINGS OF THE 2017 5TH INTERNATIONAL CONFERENCE ON MECHATRONICS, MATERIALS, CHEMISTRY AND COMPUTER ENGINEERING (ICMMCCE 2017), 2017, 141 : 647 - 651
  • [43] Vehicle trajectory prediction based on spatio-temporal Transformer feature fusion
    Zhao, Wenhong
    Wang, Wei
    Wan, Zilu
    Tongxin Xuebao/Journal on Communications, 2024, 45 (11): : 267 - 276
  • [44] Multimodal Emotion Recognition With Transformer-Based Self Supervised Feature Fusion
    Siriwardhana, Shamane
    Kaluarachchi, Tharindu
    Billinghurst, Mark
    Nanayakkara, Suranga
    IEEE ACCESS, 2020, 8 (08): : 176274 - 176285
  • [45] A Vegetable Leaf Disease Identification Model Based on Image-Text Cross-Modal Feature Fusion
    Feng, Xuguang
    Zhao, Chunjiang
    Wang, Chunshan
    Wu, Huarui
    Miao, Yisheng
    Zhang, Jingjian
    FRONTIERS IN PLANT SCIENCE, 2022, 13
  • [46] FEATURE FUSION NETWORK FOR SCENE TEXT DETECTION
    Cai, Chenqin
    Lv, Pin
    Su, Bing
    2018 25TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2018, : 2755 - 2759
  • [47] Sub-layer feature fusion applied to transformer model for automatic speech recognition
    Chen, Darong
    Yang, Guangguang
    Wei, Guangyong
    Anwaar, Fahad
    Yang, Jiaxin
    Dong, Wenxiao
    Zhang, Jiafeng
    International Journal of Speech Technology, 2024, 27 (04) : 1111 - 1120
  • [48] A Transformer-based Model Integrated with Feature Selection for Credit Card Fraud Detection
    Yuan, Miao
    PROCEEDINGS OF 2022 7TH INTERNATIONAL CONFERENCE ON MACHINE LEARNING TECHNOLOGIES, ICMLT 2022, 2022, : 185 - 190
  • [49] SFT: Few-Shot Learning via Self-Supervised Feature Fusion With Transformer
    Lim, Jit Yan
    Lim, Kian Ming
    Lee, Chin Poo
    Tan, Yong Xuan
    IEEE ACCESS, 2024, 12 : 86690 - 86703
  • [50] Construction of Transformer Fault Diagnosis and Prediction Model Based on Deep Learning
    Li X.
    Journal of Computing and Information Technology, 2022, 30 (04) : 223 - 238