RETRACTED: Arabic named entity recognition in social media based on BiLSTM-CRF using an attention mechanism (Retracted Article)

被引:3
作者
Benali, B. Ait [1 ]
Mihi, S. [1 ]
Mlouk, A. Ait [2 ]
El Bazi, I [3 ]
Laachfoubi, N. [1 ]
机构
[1] Hassan First Univ Settat, Fac Sci & Tech, IR2M Lab, Settat, Morocco
[2] Uppsala Univ, Dept Informat Technol, Div Sci Comp, Uppsala, Sweden
[3] Sultan Moulay Slimane Univ, Natl Sch Business & Management, Beni Mellal, Morocco
关键词
Arabic named entity recognition (ANER); natural language processing (NLP); multi-head self-attention; BiLSTM; CRF; dialect arabic; social media;
D O I
10.3233/JIFS-211944
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Named Entity Recognition (NER) is a vitally important task of Natural Language Processing (NLP), which aims at finding named entities in natural language text and classifying them into predefined categories such as persons (PER), places (LOC), organizations (ORG), and so on. In the Arabic context, the current NER approaches based on deep learning are mainly based on word embedding or character-level embedding as input. However, using a single granularity representation has problems with out-of-vocabulary (OOV), word embedding errors, and relatively simple semantic content. This paper presents a multi-headed self-attention mechanism implemented in the BiLSTM-CRF neural network structure to recognize Arabic named entities on social media using two embeddings. Unlike other state-of-the-art approaches, this approach combines character and word embedding at the embedding layer, and the attention mechanism calculates the similarity over the entire sequence of characters and captures local context information. The proposed approach better recognized NEs in Dialect Arabic, reaching an F1 value of 74.15% on Darwish's dataset (a publicly available Arabic NER benchmark for social media). According to our knowledge, our findings outperform the current state-of-the-art models for Arabic Named Entity Recognition on social media.
引用
收藏
页码:5427 / 5436
页数:10
相关论文
共 48 条
[41]  
Shen T, 2018, AAAI CONF ARTIF INTE, P5446
[42]   AraVec: A set of Arabic Word Embedding Models for use in Arabic NLP [J].
Soliman, Abu Bakr ;
Eissa, Kareem ;
El-Beltagy, Samhaa R. .
ARABIC COMPUTATIONAL LINGUISTICS (ACLING 2017), 2017, 117 :256-265
[43]  
Tan ZX, 2018, AAAI CONF ARTIF INTE, P4929
[44]  
van den Oord A, 2016, ISCA WORKSHOP, P124
[45]  
Vaswani A, 2017, ADV NEUR IN, V30
[46]  
Yassine Benajiba, 2008, 2008 5 INT C INF COM, DOI [10.1109/ICoICT.2017.8074647, DOI 10.1109/ICOICT.2017.8074647]
[47]  
Zaghouani W., 2012, ACM TRANS ASIAN LANG, V11, P1
[48]  
Zirikly Ayah, 2015, P 1 WORKSH VECT SPAC, P176