Effective fake news video detection using domain knowledge and multimodal data fusion on youtube

被引:28
作者
Choi, Hyewon [1 ]
Ko, Youngjoong [1 ]
机构
[1] Sungkyunkwan Univ, Dept Comp Sci & Engn, 2066 Seobu Ro, Suwon, Gyeonggi Do, South Korea
基金
新加坡国家研究基金会;
关键词
Fake news video detection; Domain knowledge; Multimodal data; Deep neural networks;
D O I
10.1016/j.patrec.2022.01.007
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In the digital age, numerous videos are being actively produced and uploaded online. Simultaneously, fake news videos to attract public attention are also on the rise. Therefore, intensive research is being conducted to detect them. Validating video content is critical for all users as the public is exposed to various fake news videos. This study proposes ways to detect fake news videos effectively using domain knowledge and multimodal data fusion. We use domain knowledge to perform learning by reflecting the potential meaning of comments, helping us detecting fake news videos. We also use the linear combination to efficiently adjust the encoding rate for each characteristic of the video and effectively detect fake news videos. In particular, the domain knowledge improves the model performance by approximately 3% for all test datasets. Consequently, we achieve an F1-score of 0.93, which is higher than those of other comparison models in all the test datasets.(c) 2022 Elsevier B.V. All rights reserved.
引用
收藏
页码:44 / 52
页数:9
相关论文
共 13 条
[1]  
[Anonymous], 2014, C EMPIRICAL METHODS
[2]   MVAE: Multimodal Variational Autoencoder for Fake News Detection [J].
Khattar, Dhruv ;
Goud, Jaipal Singh ;
Gupta, Manish ;
Varma, Vasudeva .
WEB CONFERENCE 2019: PROCEEDINGS OF THE WORLD WIDE WEB CONFERENCE (WWW 2019), 2019, :2915-2921
[3]  
Kim JH, 2016, ADV NEUR IN, V29
[4]  
Kingma DP, 2014, ADV NEUR IN, V27
[5]  
Locascio N, 2016, ARXIV PREPRINT ARXIV
[6]  
Palod P, 2019, LECT NOTES COMPUT SC, V11438, P140, DOI 10.1007/978-3-030-15719-7_18
[7]   Passive forensics in image and video using noise features: A review [J].
Pandey, Ramesh C. ;
Singh, Sanjay K. ;
Shukla, Kaushal K. .
DIGITAL INVESTIGATION, 2016, 19 :1-28
[8]  
Papadopoulou O, 2018, Invid fake video corpus v2. 0 (version 2.0)
[9]  
Pires T, 2019, 57TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2019), P4996
[10]   Explainable Machine Learning for Fake News Detection [J].
Reis, Julio C. S. ;
Correia, Andre ;
Murai, Fabricio ;
Veloso, Adriano ;
Benevenuto, Fabricio .
PROCEEDINGS OF THE 11TH ACM CONFERENCE ON WEB SCIENCE (WEBSCI'19), 2019, :17-26