Improving Low-Resource Chinese Event Detection with Multi-task Learning

被引:0
|
作者
Tong, Meihan [1 ,2 ]
Xu, Bin [1 ,2 ]
Wang, Shuai [3 ]
Hou, Lei [1 ,2 ]
Li, Juaizi [1 ,2 ]
机构
[1] Beijing Natl Res Ctr Informat Sci & Technol, Tsinghua Univ, Dept Comp Sci & Technol, Beijing 100084, Peoples R China
[2] Tsinghua Univ, Inst Artificial Intelligence, Knowledge Intelligence Res Ctr, Beijing 100084, Peoples R China
[3] JOYY Inc, Dept Technol, SLP Grp, Beijing, Peoples R China
来源
KNOWLEDGE SCIENCE, ENGINEERING AND MANAGEMENT (KSEM 2020), PT I | 2020年 / 12274卷
关键词
Chinese Event Detection; Multi-task learning; Lattice LSTM;
D O I
10.1007/978-3-030-55130-8_37
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Chinese Event Detection (CED) aims to detect events from unstructured sentences. Due to the difficulty of labeling event detection datasets, previous approaches suffer from severe data sparsity problem. To address this issue, we propose a novel Lattice LSTM based multi-task learning model. On one hand, we utilize multi-granularity word information via Lattice LSTM to fully exploit existing datasets. On the other hand, we employ the multi-task learning mechanism to improve CED with datasets from other tasks. Specifically, we combine Name Entity Recognition (NER) and Mask Word Prediction (MWP) as two auxiliary tasks to learn both entity and general language information. Experiments show that our approach outperforms the six SOTA methods by 1.9% on ACE2005 benchmark. The source code is released on https://github.com/tongmeihan1995/MLL-chinese-event-detection.
引用
收藏
页码:421 / 433
页数:13
相关论文
共 50 条
  • [1] Multi-task Learning for Low-Resource Second Language Acquisition Modeling
    Hu, Yong
    Huang, Heyan
    Lan, Tian
    Wei, Xiaochi
    Nie, Yuxiang
    Qi, Jiarui
    Yang, Liner
    Mao, Xian-Ling
    WEB AND BIG DATA, PT I, APWEB-WAIM 2020, 2020, 12317 : 603 - 611
  • [2] Multi-task Sequence Classification for Disjoint Tasks in Low-resource Languages
    Radom, Jarema
    Kocon, Jan
    KNOWLEDGE-BASED AND INTELLIGENT INFORMATION & ENGINEERING SYSTEMS (KSE 2021), 2021, 192 : 1132 - 1140
  • [3] Joint Chinese Event Extraction Based Multi-task Learning
    He R.-F.
    Duan S.-Y.
    Ruan Jian Xue Bao/Journal of Software, 2019, 30 (04): : 1015 - 1030
  • [4] Multi-Task ConvMixer Networks with Triplet Attention for Low-Resource Keyword Spotting
    Kivaisi, Alexander Rogath
    Zhao, Qingjie
    Zou, Yuanbing
    TSINGHUA SCIENCE AND TECHNOLOGY, 2025, 30 (02): : 875 - 893
  • [5] Seismic Event Detection via Deep Multi-Task Learning
    Yu, Yang
    Zhang, Lei
    Shen, Jiakai
    Wang, Qingcai
    Liu, Guiquan
    2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2020,
  • [6] Multi-task Learning with Auxiliary Cross-attention Transformer for Low-Resource Multi-dialect Speech Recognition
    Dan, Zhengjia
    Zhao, Yue
    Bi, Xiaojun
    Wu, Licheng
    Ji, Qiang
    NATURAL LANGUAGE PROCESSING AND CHINESE COMPUTING, NLPCC 2022, PT I, 2022, 13551 : 107 - 118
  • [7] Multi-task Learning for Chinese Word Usage Errors Detection
    Zhang, Jinbin
    Wang, Heng
    2018 3RD INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND APPLICATIONS (ICCIA), 2018, : 93 - 96
  • [8] Event Detection via Context Understanding Based on Multi-task Learning
    Xia, Jing
    Li, Xiaolong
    Tan, Yongbin
    Zhang, Wu
    Li, Dajun
    Xiong, Zhengkun
    ACM TRANSACTIONS ON ASIAN AND LOW-RESOURCE LANGUAGE INFORMATION PROCESSING, 2023, 22 (01)
  • [9] Deep Learning for Audio Event Detection and Tagging on Low-Resource Datasets
    Morfi, Veronica
    Stowell, Dan
    APPLIED SCIENCES-BASEL, 2018, 8 (08):
  • [10] Boosting Low-Resource Speech Recognition in Air Traffic Communication via Pretrained Feature Aggregation and Multi-Task Learning
    Guo, Dongyue
    Zhang, Zichen
    Yang, Bo
    Zhang, Jianwei
    Lin, Yi
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS, 2023, 70 (09) : 3714 - 3718