Big Data and quality data for fake news and misinformation detection

被引:80
作者
Asr, Fatemeh Torabi [1 ]
Taboada, Maite [1 ]
机构
[1] Simon Fraser Univ, Burnaby, BC, Canada
基金
加拿大自然科学与工程研究理事会;
关键词
Fake news; misinformation; labelled datasets; text classification; machine learning; topic modelling; INFORMATION;
D O I
10.1177/2053951719843310
中图分类号
C [社会科学总论];
学科分类号
03 ; 0303 ;
摘要
Fake news has become an important topic of research in a variety of disciplines including linguistics and computer science. In this paper, we explain how the problem is approached from the perspective of natural language processing, with the goal of building a system to automatically detect misinformation in news. The main challenge in this line of research is collecting quality data, i.e., instances of fake and real news articles on a balanced distribution of topics. We review available datasets and introduce the MisInfoText repository as a contribution of our lab to the community. We make available the full text of the news articles, together with veracity labels previously assigned based on manual assessment of the articles' truth content. We also perform a topic modelling experiment to elaborate on the gaps and sources of imbalance in currently available datasets to guide future efforts. We appeal to the community to collect more data and to make it available for research purposes.
引用
收藏
页数:14
相关论文
共 62 条
[1]   Detecting Hoaxes, Frauds, and Deception in Writing Style Online [J].
Afroz, Sadia ;
Brennan, Michael ;
Greenstadt, Rachel .
2012 IEEE SYMPOSIUM ON SECURITY AND PRIVACY (SP), 2012, :461-475
[2]  
[Anonymous], TECHNICAL REPORT
[3]  
[Anonymous], 2012, SENSATIONALISM MURDE
[4]  
[Anonymous], 2017, J EC PERSP
[5]  
[Anonymous], BRIT J POLIT SCI
[6]  
[Anonymous], TECH CRUNCH 0428
[7]  
[Anonymous], 2017, The New York Review
[8]  
[Anonymous], WHY IS DEEP LEARNING
[9]  
[Anonymous], WIRED MAGAZINE
[10]  
[Anonymous], TECHNICAL REPORT