Towards COVID-19 fake news detection using transformer-based models

被引:40
作者
Alghamdi, Jawaher [1 ,2 ]
Lin, Yuqing [1 ]
Luo, Suhuai [1 ]
机构
[1] Univ Newcastle, Sch Informat & Phys Sci, Newcastle, Australia
[2] King Khalid Univ, Dept Comp Sci, Abha, Saudi Arabia
关键词
COVID-19; Fake news; Misinformation; Pre-trained transformer models; Social media;
D O I
10.1016/j.knosys.2023.110642
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The COVID-19 pandemic has resulted in a surge of fake news, creating public health risks. However, developing an effective way to detect such news is challenging, especially when published news involves mixing true and false information. Detecting COVID-19 fake news has become a critical task in the field of natural language processing (NLP). This paper explores the effectiveness of several machine learning algorithms and fine-tuning pre-trained transformer-based models, including Bidirectional Encoder Representations from Transformers (BERT) and COVID-Twitter-BERT (CT-BERT), for COVID-19 fake news detection. We evaluate the performance of different downstream neural network structures, such as CNN and BiGRU layers, added on top of BERT and CT-BERT with frozen or unfrozen parameters. Our experiments on a real-world COVID-19 fake news dataset demonstrate that incorporating BiGRU on top of the CT-BERT model achieves outstanding performance, with a state-of-the-art F1 score of 98%. These results have significant implications for mitigating the spread of COVID-19 misinformation and highlight the potential of advanced machine learning models for fake news detection.& COPY; 2023 The Author(s). Published by Elsevier B.V. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/).
引用
收藏
页数:11
相关论文
共 35 条
[1]   Classification of Fake News by Fine-tuning Deep Bidirectional Transformers based Language Model [J].
Aggarwal, Akshay ;
Chauhan, Aniruddha ;
Kumar, Deepika ;
Mittal, Mamta ;
Verma, Sharad .
EAI ENDORSED TRANSACTIONS ON SCALABLE INFORMATION SYSTEMS, 2020, 7 (27) :1-12
[2]   Modeling Fake News Detection Using BERT-CNN-BiLSTM Architecture [J].
Alghamdi, Jawaher ;
Lin, Yuqing ;
Luo, Suhuai .
2022 IEEE 5TH INTERNATIONAL CONFERENCE ON MULTIMEDIA INFORMATION PROCESSING AND RETRIEVAL, MIPR, 2022, :354-357
[3]  
Bandyopadhyay S., 2020, XENO J BIOMED SCI, DOI 10.20944/PREPRINTS202006.0243.V1
[4]  
Baruah A., 2020, CLEF (Working Notes)
[5]  
Busari S., 2020, CNN
[6]  
Devlin J, 2019, Arxiv, DOI [arXiv:1810.04805, 10.48550/arxiv.1810.04805]
[7]  
Felber T, 2021, Arxiv, DOI arXiv:2101.03717
[8]   Target-Dependent Sentiment Classification With BERT [J].
Gao, Zhengjie ;
Feng, Ao ;
Song, Xinyu ;
Wu, Xi .
IEEE ACCESS, 2019, 7 :154290-154299
[9]  
Gautam A., 2023, arXiv
[10]  
Goodfellow I, 2016, ADAPT COMPUT MACH LE, P1