Paraphrase identification and semantic text similarity analysis in Arabic news tweets using lexical, syntactic, and semantic features

被引:69
作者
Al-Smadi, Mohammad [1 ]
Jaradat, Zain [1 ]
Al-Ayyoub, Mahmoud [1 ]
Jararweh, Yaser [1 ]
机构
[1] Jordan Univ Sci & Technol, Dept Comp Sci, POB 3030, Irbid 22110, Jordan
关键词
Paraphrase identification; Semantic text similarity; Semantic analysis; Arabic language; Natural language processing;
D O I
10.1016/j.ipm.2017.01.002
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The rapid growth in digital information has raised considerable challenges in particular when it comes to automated content analysis. Social media such as twitter share a lot of its users' information about their events, opinions, personalities, etc. Paraphrase Identification (PI) is concerned with recognizing whether two texts have the same/similar meaning, whereas the Semantic Text Similarity (STS) is concerned with the degree of that similarity. This research proposes a state-of-the-art approach for paraphrase identification and semantic text similarity analysis in Arabic news tweets. The approach adopts several phases of text processing, features extraction and text classification. Lexical, syntactic, and semantic features are extracted to overcome the weakness and limitations of the current technologies in solving these tasks for the Arabic language. Maximum Entropy (MaxEnt) and Support Vector Regression (SVR) classifiers are trained using these features and are evaluated using a dataset prepared for this research. The experimentation results show that the approach achieves good results in comparison to the baseline results. (c) 2017 Elsevier Ltd. All rights reserved.
引用
收藏
页码:640 / 652
页数:13
相关论文
共 67 条
  • [21] [Anonymous], P 9 INT WORKSH SEM E
  • [22] [Anonymous], 2004, P 20 INT C COMP LING
  • [23] [Anonymous], 1992, COLING 1992
  • [24] [Anonymous], 2015, P 9 INT WORKSHOP SEM, DOI DOI 10.18653/V1/S15-2046
  • [25] [Anonymous], 2015, EURASIP J WIRELESS C, DOI DOI 10.1007/S00170-015-6818-7
  • [26] [Anonymous], 2015, P 9 INT WORKSHOP SEM
  • [27] [Anonymous], 2012, SEM 2012 1 JOINT C L
  • [28] [Anonymous], 2014, P 2014 C EMP METH NA, DOI DOI 10.3115/V1/D14-1079
  • [29] [Anonymous], EUROSPEECH
  • [30] [Anonymous], 2011, ACM T INTEL SYST TEC, DOI DOI 10.1145/1961189.1961199