Effective fake news video detection using domain knowledge and multimodal data fusion on youtube

被引:23
|
作者
Choi, Hyewon [1 ]
Ko, Youngjoong [1 ]
机构
[1] Sungkyunkwan Univ, Dept Comp Sci & Engn, 2066 Seobu Ro, Suwon, Gyeonggi Do, South Korea
基金
新加坡国家研究基金会;
关键词
Fake news video detection; Domain knowledge; Multimodal data; Deep neural networks;
D O I
10.1016/j.patrec.2022.01.007
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In the digital age, numerous videos are being actively produced and uploaded online. Simultaneously, fake news videos to attract public attention are also on the rise. Therefore, intensive research is being conducted to detect them. Validating video content is critical for all users as the public is exposed to various fake news videos. This study proposes ways to detect fake news videos effectively using domain knowledge and multimodal data fusion. We use domain knowledge to perform learning by reflecting the potential meaning of comments, helping us detecting fake news videos. We also use the linear combination to efficiently adjust the encoding rate for each characteristic of the video and effectively detect fake news videos. In particular, the domain knowledge improves the model performance by approximately 3% for all test datasets. Consequently, we achieve an F1-score of 0.93, which is higher than those of other comparison models in all the test datasets.(c) 2022 Elsevier B.V. All rights reserved.
引用
收藏
页码:44 / 52
页数:9
相关论文
共 50 条
  • [21] A mutual attention based multimodal fusion for fake news detection on social network
    Ying Guo
    Applied Intelligence, 2023, 53 : 15311 - 15320
  • [22] OVERVIEW OF MULTIMODAL DATA AND ITS APPLICATION TO FAKE- NEWS DETECTION
    Boyko, Nataliya
    JORDANIAN JOURNAL OF COMPUTERS AND INFORMATION TECHNOLOGY, 2024, 10 (03): : 281 - 293
  • [23] Fake News Detection Using Stance Extracted Multimodal Fusion-Based Hybrid Neural Network
    Sengan, Sudhakar
    Vairavasundaram, Subramaniyaswamy
    Ravi, Logesh
    AlHamad, Ahmad Qasim Mohammad
    Alkhazaleh, Hamzah Ali
    Alharbi, Meshal
    IEEE TRANSACTIONS ON COMPUTATIONAL SOCIAL SYSTEMS, 2024, 11 (04): : 5146 - 5157
  • [24] Knowledge-aware multimodal pre-training for fake news detection
    Zhang, Litian
    Zhang, Xiaoming
    Zhou, Ziyi
    Zhang, Xi
    Yu, Philip S.
    Li, Chaozhuo
    INFORMATION FUSION, 2025, 114
  • [25] Multimodal Fake News Detection Incorporating External Knowledge and User Interaction Feature
    Fu, Lifang
    Liu, Shuai
    ADVANCES IN MULTIMEDIA, 2023, 2023
  • [26] Knowledge augmented transformer for adversarial multidomain multiclassification multimodal fake news detection
    Song, Chenguang
    Ning, Nianwen
    Zhang, Yunlei
    Wu, Bin
    NEUROCOMPUTING, 2021, 462 : 88 - 100
  • [27] Fake News Detection Based on Multimodal Inputs
    Liang, Zhiping
    CMC-COMPUTERS MATERIALS & CONTINUA, 2023, 75 (02): : 4519 - 4534
  • [28] Multimodal Approaches based on Fake News Detection
    Reddy, Bandi Sravani
    Siva Kumar, A.P.
    Proceedings of the 3rd International Conference on Artificial Intelligence and Smart Energy, ICAIS 2023, 2023, : 751 - 755
  • [29] Improving Generalization for Multimodal Fake News Detection
    Tahmasebi, Sahar
    Hakimov, Sherzod
    Ewerth, Ralph
    Mueller-Budack, Eric
    PROCEEDINGS OF THE 2023 ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA RETRIEVAL, ICMR 2023, 2023, : 581 - 585
  • [30] Fake Video News Detection Using Deep Learning Algorithm
    Pimple, Kanchan M.
    Solanke, Ravindra R.
    Likhitkar, Praveen P.
    Pande, Sagar
    PROCEEDINGS OF THIRD DOCTORAL SYMPOSIUM ON COMPUTATIONAL INTELLIGENCE, DOSCI 2022, 2023, 479 : 851 - 857