Chinese Clinical Named Entity Recognition Using Residual Dilated Convolutional Neural Network With Conditional Random Field

被引:63
|
作者
Qiu, Jiahui [1 ]
Zhou, Yangming [1 ]
Wang, Qi [1 ]
Ruan, Tong [1 ]
Gao, Ju [2 ]
机构
[1] East China Univ Sci & Technol, Sch Informat Sci & Engn, Shanghai 200237, Peoples R China
[2] Shanghai Shuguang Hosp, Shanghai 200120, Peoples R China
基金
中国国家自然科学基金;
关键词
Electronic health records; clinical named entity recognition; residual dilated convolutional neural network; conditional random field; TEXT;
D O I
10.1109/TNB.2019.2908678
中图分类号
Q5 [生物化学];
学科分类号
071010 ; 081704 ;
摘要
Clinical named entity recognition (CNER) is a fundamental and crucial task for clinical and translation research. In recent years, deep learning methods have achieved significant success in CNER tasks. However, these methods depend greatly on recurrent neural networks (RNNs), which maintain a vector of hidden activations that are propagated through time, thus causing too much time to train models. In this paper, we propose a residual dilated convolutional neural network with the conditional random field (RD-CNN-CRF) for the Chinese CNER, which makes the model asynchronous in computation and thus speeding up the training period dramatically. To be more specific, Chinese characters and dictionary features are first projected into dense vector representations, then they are fed into the residual dilated convolutional neural network to capture contextual features. Finally, a conditional random field is employed to capture dependencies between neighboring tags and obtain the optimal tag sequence for the entire sequence. Computational results on the CCKS-2017 Task 2 benchmark dataset show that our proposed RD-CNN-CRF method competes favorably with state-of-the-art RNN-based methods both in terms of computational performance and training time.
引用
收藏
页码:306 / 315
页数:10
相关论文
共 50 条
  • [1] Fast and effective biomedical named entity recognition using temporal convolutional network with conditional random field
    Che, Chao
    Zhou, Chengjie
    Zhao, Hanyu
    Jin, Bo
    Gao, Zhan
    MATHEMATICAL BIOSCIENCES AND ENGINEERING, 2020, 17 (04) : 3553 - 3566
  • [2] Medical named entity recognition based on dilated convolutional neural network
    Zhang R.
    Zhao P.
    Guo W.
    Wang R.
    Lu W.
    Cognitive Robotics, 2022, 2 : 13 - 20
  • [3] Named Entity Recognition for Chinese microblog with Convolutional Neural Network
    Zhang, Liang
    Zhao, Huan
    2017 13TH INTERNATIONAL CONFERENCE ON NATURAL COMPUTATION, FUZZY SYSTEMS AND KNOWLEDGE DISCOVERY (ICNC-FSKD), 2017, : 87 - 92
  • [4] Chinese Named Entity Recognition Based on Rules and Conditional Random Field
    Liu, Weiming
    Yu, Bin
    Zhang, Chen
    Wang, Han
    Pan, Ke
    PROCEEDINGS OF 2018 THE 2ND INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND ARTIFICIAL INTELLIGENCE (CSAI 2018) / 2018 THE 10TH INTERNATIONAL CONFERENCE ON INFORMATION AND MULTIMEDIA TECHNOLOGY (ICIMT 2018), 2018, : 268 - 272
  • [5] Chinese Named Entity Recognition Using Modified Conditional Random Field on Postal Address
    Sun, Wenqiao
    2017 10TH INTERNATIONAL CONGRESS ON IMAGE AND SIGNAL PROCESSING, BIOMEDICAL ENGINEERING AND INFORMATICS (CISP-BMEI), 2017,
  • [6] Named entity recognition for Chinese construction documents based on conditional random field
    ZHANG Qiqi
    XUE Cong
    SU Xing
    ZHOU Peng
    WANG Xiangyu
    ZHANG Jiansong
    Frontiers of Engineering Management, 2023, 10 (02) : 237 - 249
  • [7] Named entity recognition for Chinese construction documents based on conditional random field
    Qiqi Zhang
    Cong Xue
    Xing Su
    Peng Zhou
    Xiangyu Wang
    Jiansong Zhang
    Frontiers of Engineering Management, 2023, 10 : 237 - 249
  • [8] Named entity recognition for Chinese construction documents based on conditional random field
    Zhang, Qiqi
    Xue, Cong
    Su, Xing
    Zhou, Peng
    Wang, Xiangyu
    Zhang, Jiansong
    FRONTIERS OF ENGINEERING MANAGEMENT, 2023, 10 (02) : 237 - 249
  • [9] Named Entity Recognition in Chinese Clinical Text Using Deep Neural Network
    Wu, Yonghui
    Jiang, Min
    Lei, Jianbo
    Xu, Hua
    MEDINFO 2015: EHEALTH-ENABLED HEALTH, 2015, 216 : 624 - 628
  • [10] BiGCNN: Bidirectional Gated Convolutional Neural Network for Chinese Named Entity Recognition
    Zhao, Tianyang
    Liu, Haoyan
    Wu, Qianhui
    Sun, Changzhi
    Zhan, Dongdong
    Li, Zhoujun
    DATABASE SYSTEMS FOR ADVANCED APPLICATIONS (DASFAA 2020), PT I, 2020, 12112 : 502 - 518