Multi-Feature Fusion Transformer for Chinese Named Entity Recognition

被引:0
作者
Han, Xiaokai [1 ]
Yue, Qi [1 ]
Chu, Jing [1 ]
Han, Zhan [1 ]
Shi, Yifan [1 ]
Wang, Chengfeng [1 ]
机构
[1] Xian Univ Posts & Telecommun, Sch Automat, Xian, Peoples R China
来源
2022 41ST CHINESE CONTROL CONFERENCE (CCC) | 2022年
关键词
Multi feature; Radical; Semantic enhancements; Transformer; Chinese named entity recognition;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Recently, an approach to enhancing semantic and entity boundaries through lexicons has been used in Chinese named entity recognition tasks to improve recognition rate. However, this approach ignores the radicals of Chinese characters. As a kind of characters that evolve from pictographs, a lot of information is embedded in the radicals of Chinese characters. This paper proposes a novel Chinese named entity recognition method, named Multi-feature Fusion Transformer (MFT), which exploits the information of the radicals of Chinese characters. Our model is able to further enhance the semantic information by adding the radical information of Chinese characters while using word features. We have also improved the basic structure of the Transformer model to make the model perform better in entity recognition. Our model is compared with other mainstream models on Resume dataset and Weibo dataset, the experimental results show that our model is significantly better than other models, with F1 score of 95.77% and 64.38% for the respective dataset.
引用
收藏
页码:4227 / 4232
页数:6
相关论文
共 18 条
  • [1] [Anonymous], 2020, P 58 ANN M ASS COMP
  • [2] Collobert R, 2011, J MACH LEARN RES, V12, P2493
  • [3] Dai ZH, 2019, 57TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2019), P2978
  • [4] Core techniques of question answering systems over knowledge bases: a survey
    Diefenbach, Dennis
    Lopez, Vanessa
    Singh, Kamal
    Maret, Pierre
    [J]. KNOWLEDGE AND INFORMATION SYSTEMS, 2018, 55 (03) : 529 - 569
  • [5] Character-Based LSTM-CRF with Radical-Level Features for Chinese Named Entity Recognition
    Dong, Chuanhai
    Zhang, Jiajun
    Zong, Chengqing
    Hattori, Masanori
    Di, Hui
    [J]. NATURAL LANGUAGE UNDERSTANDING AND INTELLIGENT APPLICATIONS (NLPCC 2016), 2016, 10102 : 239 - 250
  • [6] Dos Santos C., 2014, P COLING 2014 25 INT, P69
  • [7] Gui T, 2019, PROCEEDINGS OF THE TWENTY-EIGHTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, P4982
  • [8] Guo QP, 2019, 2019 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES (NAACL HLT 2019), VOL. 1, P1315
  • [9] Hammerton J., 2003, ASS COMPUTATIONAL LI, P172
  • [10] Kim Y., 2014, ARXIV PREPRINT ARXIV