Identifying Relationship of Chinese Characters with Attention Mechanism and Convolutional Neural Network

被引:0
作者
Pengwu Z. [1 ]
Zhiyi L. [2 ]
Xiaoqi L. [2 ]
机构
[1] Institute of Scientific and Technical Information of China, Beijing
[2] School of Economics & Management, South China Normal University, Guangzhou
关键词
Attention Mechanism; Chinese Character; Convolutional Neural Network; Relationship Extraction; Relationship Recognition;
D O I
10.11925/infotech.2096-3467.2021.1079
中图分类号
学科分类号
摘要
[Objective] The paper tries to identify the features and relationship of dynamic semantic information from the Chinese character entities. [Methods] First, we used the attention mechanism and improved convolution neural network model to automatically extract features from the training data of public corpus with character entity relationship. Then, we compared our model’s performance with the existing ones from the perspectives of entity relationship recognition efficiency, as well as entity relationship extraction effects and efficiency. [Results] The performance of CNN+Attention model is better than those of the SVM, LR, LSTM, BiLSTM and CNN model in prediction accuracy. Our new model is 0.92% higher in accuracy, 0.80% higher in recall and 0.86% higher in F1 value than the BiLSTM model with relatively better extraction effect. [Limitations] We need to examine our model with more sample data sets. [Conclusions] The proposed model could effectively improve the accuracy and recall of entity relationship extraction for Chinese characters. © 2022, Chinese Academy of Sciences. All rights reserved.
引用
收藏
页码:41 / 51
页数:10
相关论文
共 24 条
  • [1] Bekoulis G, Deleu J, Demeester T, Et al., Joint Entity Recognition and Relation Extraction as A Multi-Head Selection Problem, Expert Systems with Applications, 114, pp. 34-45, (2018)
  • [2] Kim E K, Choi K S., Improving Distantly Supervised Relation Extraction by Knowledge Base-Driven Zero Subject Resolution, IEICE Transactions on Information and Systems, E101, 10, pp. 2551-2558, (2018)
  • [3] Jia Zhen, Ye Zhonglin, Yin Hongfeng, Et al., Weakly Supervised Relation Extraction Based on Tri-training and Noise Filtering, Journal of Chinese Information Processing, 30, 4, pp. 142-149, (2016)
  • [4] Gan Lixin, Wan Changxuan, Liu Dexi, Et al., Chinese Named Entity Relation Extraction Based on Syntactic and Semantic Features, Journal of Computer Research and Development, 53, 2, pp. 284-302, (2016)
  • [5] Wu Sheng, Liu Maofu, Hu Huijun, Et al., Unsupervised Extraction of Attribute-Value Entity Relation from Chinese Texts, Journal of Wuhan University (Natural Science Edition), 62, 6, pp. 552-560, (2016)
  • [6] Rong Bohui, Fu Kun, Huang Yu, Et al., Relation Extraction Based on Multi-Channel Convolutional Neural Network, Application Research of Computers, 34, 3, pp. 689-692, (2017)
  • [7] Zhang Xiaobin, Chen Fucai, Huang Ruiyang, Relation Extraction Based on CNN and Bi-LSTM, Chinese Journal of Network and Information Security, 4, 9, pp. 44-51, (2018)
  • [8] Yan Haoran, Jin Xiaolong, Jia Yantao, Et al., An Improved Entity Relation Extraction Algorithm——OptMultiR, Journal of Chinese Information Processing, 32, 9, pp. 66-74, (2018)
  • [9] Che Jinli, Tang Liwei, Deng Shijie, Et al., Distant Supervision Chinese Relation Extraction Based on Dual Attention Mechanism, Computer Engineering and Applications, 55, 20, pp. 107-113, (2019)
  • [10] Cui Z Y, Pan L, Liu S J., Hybrid BiLSTM-Siamese Network for Relation Extraction, Proceedings of the 18th International Conference on Autonomous Agents and MultiAgent Systems, pp. 1907-1909, (2019)