Effective fake news video detection using domain knowledge and multimodal data fusion on youtube

被引:23
|
作者
Choi, Hyewon [1 ]
Ko, Youngjoong [1 ]
机构
[1] Sungkyunkwan Univ, Dept Comp Sci & Engn, 2066 Seobu Ro, Suwon, Gyeonggi Do, South Korea
基金
新加坡国家研究基金会;
关键词
Fake news video detection; Domain knowledge; Multimodal data; Deep neural networks;
D O I
10.1016/j.patrec.2022.01.007
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In the digital age, numerous videos are being actively produced and uploaded online. Simultaneously, fake news videos to attract public attention are also on the rise. Therefore, intensive research is being conducted to detect them. Validating video content is critical for all users as the public is exposed to various fake news videos. This study proposes ways to detect fake news videos effectively using domain knowledge and multimodal data fusion. We use domain knowledge to perform learning by reflecting the potential meaning of comments, helping us detecting fake news videos. We also use the linear combination to efficiently adjust the encoding rate for each characteristic of the video and effectively detect fake news videos. In particular, the domain knowledge improves the model performance by approximately 3% for all test datasets. Consequently, we achieve an F1-score of 0.93, which is higher than those of other comparison models in all the test datasets.(c) 2022 Elsevier B.V. All rights reserved.
引用
收藏
页码:44 / 52
页数:9
相关论文
共 44 条
  • [41] FusionSense: Emotion Classification Using Feature Fusion of Multimodal Data and Deep Learning in a Brain-Inspired Spiking Neural Network
    Tan, Clarence
    Ceballos, Gerardo
    Kasabov, Nikola
    Puthanmadam Subramaniyam, Narayan
    SENSORS, 2020, 20 (18) : 1 - 27
  • [42] Heart beat detection in multimodal physiological data using a hidden semi-Markov model and signal quality indices
    Pimentel, Marco A. F.
    Santos, Mauro D.
    Springer, David B.
    Clifford, Gari D.
    PHYSIOLOGICAL MEASUREMENT, 2015, 36 (08) : 1717 - 1727
  • [43] Domain-Knowledge-Guided Multisource Fusion Network for Small Water Bodies Mapping Using PlanetScope Multispectral and Google Earth RGB Images
    Zhou, Pu
    Li, Xiaodong
    Zhang, Yihang
    Wang, Yalan
    Li, Yuyang
    Li, Xiang
    Zhou, Chi
    Shen, Laiyin
    Du, Yun
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2025, 18 : 2541 - 2562
  • [44] A personalized summarization of video life-logs from an indoor multi-camera system using a fuzzy rule-based system with domain knowledge
    Park, Han-Saem
    Cho, Sung-Bae
    INFORMATION SYSTEMS, 2011, 36 (08) : 1124 - 1134