Integrating Text Embedding with Traditional NLP Features for Clinical Relation Extraction

被引:7
作者
Hasan, Fatema [1 ]
Roy, Arpita [1 ]
Pan, Shimei [1 ]
机构
[1] Univ Maryland, Dept Informat Syst, Baltimore, MD 21201 USA
来源
2020 IEEE 32ND INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE (ICTAI) | 2020年
关键词
Relation Extraction; IE; Clinical Text; BERT; Word2Vec; Neural Networks; MIMIC-III; i2b2;
D O I
10.1109/ICTAI50040.2020.00072
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recently, text embedding techniques such as Word2Vec and BERT have produced state-of-the-art results in a wide variety of NLP tasks. As a result, traditional NLP features frequently used in Information Extraction (IE) such as POS tags, dependency relations and semantic types have received less attention. In this paper, we investigate whether traditional NLP features can be combined with word and sentence embeddings to improve relation extraction. We have explored diverse feature sets and different neural network architectures and evaluated our models on a benchmark clinical text dataset. Our new models significantly outperformed all the baselines on the same dataset.
引用
收藏
页码:418 / 425
页数:8
相关论文
共 38 条
  • [1] Alsentzer E., 2019, P 2 CLIN NAT LANG PR, P72, DOI DOI 10.18653/V1/W19-1909
  • [2] Anick P., 2010, P 2020 I2B2 VA WORKS
  • [3] [Anonymous], 2010, P 2010 I2B2 VA WORKS
  • [4] [Anonymous], 2010, P 2010 I2B2 VA WORKS
  • [5] Assoc Computat L., 2018, ARXIV
  • [6] Cartoni B., 2010, I2B2 MED EXTR CHALL
  • [7] Cohen A. M., 2010, P 2010 I2B2 VA WORKS
  • [8] de Bruijn B., 2010, P 2010 I2B2 VA WORKS
  • [9] Guo ZJ, 2019, 57TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2019), P241
  • [10] Deep Residual Learning for Image Recognition
    He, Kaiming
    Zhang, Xiangyu
    Ren, Shaoqing
    Sun, Jian
    [J]. 2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 770 - 778