Chinese Named Entity Recognition for Hazard And Operability Analysis Text Based on Albert

被引:0
|
作者
Wang, Zhenhua [1 ]
Zhang, Beike [1 ]
Gao, Dong [1 ]
机构
[1] Beijing Univ Chem Technol, Coll Informat Sci & Technol, Beijing, Peoples R China
来源
2020 CHINESE AUTOMATION CONGRESS (CAC 2020) | 2020年
基金
中国国家自然科学基金;
关键词
Chinese named entity recognition; HAZOP; Albert; BiLSTM-CRF;
D O I
10.1109/CAC51589.2020.9326618
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
HAZOP plays an important role in chemical safety, in the project of Chinese named entity recognition of HAZOP, In response to the problem of low accuracy of entity recognition and low efficiency of model training in the past methods, this paper proposes Albert-BiLSTM-CRF model. In the process of text pre-training, we use Albert model instead of word2vec, Bert, CNN and other traditional structures to train word vectors, and get word embedding at the character level related to context, which improves the ability of text feature extraction. The experiments show that: on the basis of the accuracy of entity recognition, the Fl-score of this model on HAZOP test corpus reaches 91.09%, which is 2.27% and 2.36% higher than that of BiLSTM-CRF model and CNN-BiLSTM-CRF model, and is equivalent to Bert-BiLSTM-CRF model, with Fl-score exceeding 90% on the basis of the speed of model training, the average training time of each epoch is only 162 seconds, which is faster than the training speed of other models under the same configuration environment. The results reflect that the Albert-BiLSTM-CRF model can better solve the shortcomings of the previous models, not only to ensure high accuracy of entity recognition, but also to improve the training speed of the model. This model is more suitable for HAZOP in named entity recognition project.
引用
收藏
页码:5641 / 5645
页数:5
相关论文
共 50 条
  • [21] Deep adaptation of CNN in Chinese named entity recognition
    Lv, Yana
    Qin, Xutong
    Du, Xiuli
    Qiu, Shaoming
    ENGINEERING REPORTS, 2023, 5 (06)
  • [22] Utilizing Chinese Dictionary Information in Named Entity Recognition
    Hu, Yun
    Liao, Mingxue
    Lv, Pin
    Zheng, Changwen
    COGNITIVE SYSTEMS AND SIGNAL PROCESSING, PT II, 2019, 1006 : 17 - 26
  • [23] Survey on Chinese named entity recognition with deep learning
    Kang Y.
    Sun L.
    Zhu R.
    Li M.
    Huazhong Keji Daxue Xuebao (Ziran Kexue Ban)/Journal of Huazhong University of Science and Technology (Natural Science Edition), 2022, 50 (11): : 44 - 53
  • [24] Research of Chinese Named Entity Recognition Using GATE
    Cheng, Chen
    Cheng, Xianyi
    Hua, Jin
    BIOTECHNOLOGY, CHEMICAL AND MATERIALS ENGINEERING, PTS 1-3, 2012, 393-395 : 262 - 264
  • [25] Rethinking the Value of Gazetteer in Chinese Named Entity Recognition
    Chen, Qianglong
    Zeng, Xiangji
    Zhu, Jiangang
    Zhang, Yin
    Lin, Bojia
    Yang, Yang
    Jiang, Daxin
    NATURAL LANGUAGE PROCESSING AND CHINESE COMPUTING, NLPCC 2022, PT I, 2022, 13551 : 285 - 297
  • [26] Chinese named entity recognition method based on Transformer and hidden Markov model
    Li J.
    Xiong Q.
    Hu Y.-T.
    Liu K.-Y.
    Jilin Daxue Xuebao (Gongxueban)/Journal of Jilin University (Engineering and Technology Edition), 2023, 53 (05): : 1427 - 1434
  • [27] Chinese Named Entity Recognition Method Based on Dictionary Semantic Knowledge Enhancement
    Wang, Tianbin
    Huang, Ruiyang
    Hu, Nan
    Wang, Huansha
    Chu, Guanghan
    IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2023, E106D (05) : 1010 - 1017
  • [28] Lexicon Graph Adapter Based BERT Model for Chinese Named Entity Recognition
    Liu, Jie
    Liu, Peipei
    Ren, Yimo
    Wang, Jinfa
    Zhu, Hongsong
    KNOWLEDGE SCIENCE, ENGINEERING AND MANAGEMENT, PT V, KSEM 2024, 2024, 14888 : 95 - 105
  • [29] Chinese Named Entity Recognition Model Based on Multi-Task Learning
    Fang, Qin
    Li, Yane
    Feng, Hailin
    Ruan, Yaoping
    APPLIED SCIENCES-BASEL, 2023, 13 (08):
  • [30] Study on Chinese Named Entity Recognition Based on Dynamic Fusion and Adversarial Training
    Fan, Fei
    Yang, Linnan
    Wu, Xingyu
    Lin, Shengken
    Dong, Huijie
    Yin, Changshan
    KNOWLEDGE SCIENCE, ENGINEERING AND MANAGEMENT, KSEM 2022, PT III, 2022, 13370 : 3 - 14