Effective hate-speech detection in Twitter data using recurrent neural networks

被引:121
作者
Pitsilis, Georgios K. [1 ]
Ramampiaro, Heri [1 ]
Langseth, Helge [1 ]
机构
[1] Norwegian Univ Sci & Technol NTNU, Dept Comp Sci, NO-7491 Trondheim, Norway
关键词
Text classification; Micro-blogging; Hate-speech; Deep learning; Recurrent neural networks; Twitter;
D O I
10.1007/s10489-018-1242-y
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper addresses the important problem of discerning hateful content in social media. We propose a detection scheme that is an ensemble of Recurrent Neural Network (RNN) classifiers, and it incorporates various features associated with user-related information, such as the users' tendency towards racism or sexism. This data is fed as input to the above classifiers along with the word frequency vectors derived from the textual content. We evaluate our approach on a publicly available corpus of 16k tweets, and the results demonstrate its effectiveness in comparison to existing state-of-the-art solutions. More specifically, our scheme can successfully distinguish racism and sexism messages from normal text, and achieve higher classification quality than current state-of-the-art algorithms.
引用
收藏
页码:4730 / 4742
页数:13
相关论文
共 23 条
[1]  
[Anonymous], 2016, P NAACL STUD RES WOR
[2]  
[Anonymous], P 3 INT C LEARN REPR
[3]  
[Anonymous], 2017, P 1 WORKSH AB LANG O
[4]  
[Anonymous], 2017, P 2 WORKSH NLP COMP
[5]  
[Anonymous], 2017, P ACL
[6]  
[Anonymous], 2017, NEWYORKTIMES
[7]   Deep Learning for Hate Speech Detection in Tweets [J].
Badjatiya, Pinkesh ;
Gupta, Shashank ;
Gupta, Manish ;
Varma, Vasudeva .
WWW'17 COMPANION: PROCEEDINGS OF THE 26TH INTERNATIONAL CONFERENCE ON WORLD WIDE WEB, 2017, :759-760
[8]   Opinion Mining and Sentiment Polarity on Twitter and Correlation Between Events and Sentiment [J].
Barnaghi, Peiman ;
Breslin, John G. ;
Ghaffari, Parsa .
PROCEEDINGS 2016 IEEE SECOND INTERNATIONAL CONFERENCE ON BIG DATA COMPUTING SERVICE AND APPLICATIONS (BIGDATASERVICE 2016), 2016, :52-57
[9]   Detecting Offensive Language in Social Media to Protect Adolescent Online Safety [J].
Chen, Ying ;
Zhou, Yilu ;
Zhu, Sencun ;
Xu, Heng .
PROCEEDINGS OF 2012 ASE/IEEE INTERNATIONAL CONFERENCE ON PRIVACY, SECURITY, RISK AND TRUST AND 2012 ASE/IEEE INTERNATIONAL CONFERENCE ON SOCIAL COMPUTING (SOCIALCOM/PASSAT 2012), 2012, :71-80
[10]  
Davidson T., 2017, ICWSM, P512