Research on Chinese Semantic Named Entity Recognition in Marine Engine Room Systems Based on BERT

被引:4
作者
Shen, Henglong [1 ]
Cao, Hui [1 ]
Sun, Guangxi [1 ]
Chen, Dong [1 ]
机构
[1] Dalian Maritime Univ, Marine Engn Coll, Dalian 116026, Peoples R China
关键词
marine engine room; named entity recognition; BERT model; deep learning; attention mechanism; LSTM;
D O I
10.3390/jmse11071266
中图分类号
U6 [水路运输]; P75 [海洋工程];
学科分类号
0814 ; 081505 ; 0824 ; 082401 ;
摘要
With the development of intelligentization in maritime vessels, the pursuit of an organized and scalable knowledge storage approach for marine engine room systems has become one of the current research hotspots. This study addressed the foundational named entity recognition (NER) task in constructing a knowledge graph for marine engine rooms. It proposed an entity recognition algorithm for Chinese semantics in marine engine rooms that integrates language models. Firstly, the bidirectional encoder representation from transformers (BERT) language model is used to extract text features and obtain word-level granularity vector matrices. Secondly, the trained word embeddings are fed into a bidirectional long short-term memory network (BiLSTM) to extract contextual information. It considers the surrounding words and their sequential relationships, enabling a better understanding of the context. Additionally, the conditional random field (CRF) model was used to extract the globally optimal sequence of named entities in the marine engine room semantic. The CRF model considered the dependencies between adjacent entities that ensured a coherent and consistent final result for entity recognition in marine engine room semantics. The experiment results demonstrate that the proposed algorithm achieves superior F1 scores for all three entity types. Compared with BERT, the overall precision, recall, and F1 score of the entity recognition are improved by 1.36%, 1.41%, and 1.38%, respectively. Future research will be carried out on named entity recognition of a small sample set to provide basic support for more efficient entity relationship extraction and construction of a marine engine room knowledge graph.
引用
收藏
页数:19
相关论文
共 25 条
  • [1] Feature selection in image analysis: a survey
    Bolon-Canedo, Veronica
    Remeseiro, Beatriz
    [J]. ARTIFICIAL INTELLIGENCE REVIEW, 2020, 53 (04) : 2905 - 2931
  • [2] Chiticariu L., 2010, P 2010 C EMPIRICAL M, P1002
  • [3] Collobert R, 2011, J MACH LEARN RES, V12, P2493
  • [4] Cristianini N., 2000, INTRO SUPPORT VECTOR, DOI DOI 10.1017/CBO9780511801389
  • [5] Devlin J, 2019, 2019 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES (NAACL HLT 2019), VOL. 1, P4171
  • [6] Duhaney J.A., 2012, THESIS FLORIDA ATLAN
  • [7] Hidden Markov models
    Eddy, SR
    [J]. CURRENT OPINION IN STRUCTURAL BIOLOGY, 1996, 6 (03) : 361 - 365
  • [8] Online Prediction of Ship Behavior with Automatic Identification System Sensor Data Using Bidirectional Long Short-Term Memory Recurrent Neural Network
    Gao, Miao
    Shi, Guoyou
    Li, Shuang
    [J]. SENSORS, 2018, 18 (12)
  • [9] Framewise phoneme classification with bidirectional LSTM and other neural network architectures
    Graves, A
    Schmidhuber, J
    [J]. NEURAL NETWORKS, 2005, 18 (5-6) : 602 - 610
  • [10] Grishman R., 1996, COLING 1996 VOLUME 1