BGCFormer: A Text Event Feature Fusion Learning Model based on Transformer

被引:0
|
作者
Liu, Yulong [1 ]
Wang, Juan [1 ]
Li, Qian [1 ]
机构
[1] China Elect Technol Grp Corp, Res Inst 15, Beijing, Peoples R China
来源
2023 8TH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING AND BIG DATA ANALYTICS, ICCCBDA | 2023年
关键词
event extraction; graph convolution networks; deep learning; transformer; information extraction;
D O I
10.1109/ICCCBDA56900.2023.10154819
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Event extraction is an essential task in natural language processing, as it involves extracting meaningful events from text documents, which is important for a variety of applications, such as information retrieval, question answering, and text summarization, yet challenges remain when extracting events from documents, which is that a document usually contain multiple sentences together form a complete event, and entities in the same event may span multiple sentences. To address these challenges, this paper proposes a transformer with features fusion learning model (BGCFormer), which is based on a transformer architecture with GCN and encoder attention mechanism, and it can build a feature fusion learning network to capture global interaction features between different sentences and entity mentions. Experiments conducted on a large-scale dataset have demonstrated the proposed model outperforms existing methods in terms of accuracy and efficiency.
引用
收藏
页码:157 / 161
页数:5
相关论文
共 50 条
  • [1] An Entity Recognition Model Based on Deep Learning Fusion of Text Feature
    Shang, Fengjun
    Ran, Chunfu
    INFORMATION PROCESSING & MANAGEMENT, 2022, 59 (02)
  • [2] An Efficient Text-Independent Speaker Identification Using Feature Fusion and Transformer Model
    Khan, Arfat Ahmad
    Jahangir, Rashid
    Alroobaea, Roobaea
    Alyahyan, Saleh Yahya
    Almulhi, Ahmed H.
    Alsafyani, Majed
    Wechtaisong, Chitapong
    CMC-COMPUTERS MATERIALS & CONTINUA, 2023, 75 (02): : 4085 - 4100
  • [3] Conditional Feature Learning Based Transformer for Text-Based Person Search
    Gao, Chenyang
    Cai, Guanyu
    Jiang, Xinyang
    Zheng, Feng
    Zhang, Jun
    Gong, Yifei
    Lin, Fangzhou
    Sun, Xing
    Bai, Xiang
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 6097 - 6108
  • [4] Learning modality feature fusion via transformer for RGBT-tracking
    Cai, Yujue
    Sui, Xiubao
    Gu, Guohua
    Chen, Qian
    INFRARED PHYSICS & TECHNOLOGY, 2023, 133
  • [5] Breast cancer lesion segmentation based on co-learning feature fusion and Transformer
    Zhai Y.
    Chen Z.
    Shao D.
    Shengwu Yixue Gongchengxue Zazhi/Journal of Biomedical Engineering, 2024, 41 (02): : 237 - 245
  • [6] Transformer-based Question Text Generation in the Learning System
    Li, Jiajun
    Song, Huazhu
    Li, Jun
    6TH INTERNATIONAL CONFERENCE ON INNOVATION IN ARTIFICIAL INTELLIGENCE, ICIAI2022, 2022, : 50 - 56
  • [7] Semantic segmentation feature fusion network based on transformer
    Li, Tianping
    Cui, Zhaotong
    Zhang, Hua
    SCIENTIFIC REPORTS, 2025, 15 (01):
  • [8] A planetary gearbox fault diagnosis method based on time-series imaging feature fusion and a transformer model
    Wu, Rui
    Liu, Chao
    Han, Te
    Yao, Jiachi
    Jiang, Dongxiang
    MEASUREMENT SCIENCE AND TECHNOLOGY, 2023, 34 (02)
  • [9] Transformer Fault Recognition Based on Kbert Text Clustering Model
    Jiang C.
    Wang Y.
    Chen M.
    Li C.
    Wang Y.
    Ma G.
    Gaodianya Jishu/High Voltage Engineering, 2022, 48 (08): : 2991 - 3000
  • [10] Heterogeneous Feature Fusion Module Based on CNN and Transformer for Multiview Stereo Reconstruction
    Gao, Rui
    Xu, Jiajia
    Chen, Yipeng
    Cho, Kyungeun
    MATHEMATICS, 2023, 11 (01)