Effective fake news video detection using domain knowledge and multimodal data fusion on youtube

被引:23
|
作者
Choi, Hyewon [1 ]
Ko, Youngjoong [1 ]
机构
[1] Sungkyunkwan Univ, Dept Comp Sci & Engn, 2066 Seobu Ro, Suwon, Gyeonggi Do, South Korea
基金
新加坡国家研究基金会;
关键词
Fake news video detection; Domain knowledge; Multimodal data; Deep neural networks;
D O I
10.1016/j.patrec.2022.01.007
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In the digital age, numerous videos are being actively produced and uploaded online. Simultaneously, fake news videos to attract public attention are also on the rise. Therefore, intensive research is being conducted to detect them. Validating video content is critical for all users as the public is exposed to various fake news videos. This study proposes ways to detect fake news videos effectively using domain knowledge and multimodal data fusion. We use domain knowledge to perform learning by reflecting the potential meaning of comments, helping us detecting fake news videos. We also use the linear combination to efficiently adjust the encoding rate for each characteristic of the video and effectively detect fake news videos. In particular, the domain knowledge improves the model performance by approximately 3% for all test datasets. Consequently, we achieve an F1-score of 0.93, which is higher than those of other comparison models in all the test datasets.(c) 2022 Elsevier B.V. All rights reserved.
引用
收藏
页码:44 / 52
页数:9
相关论文
共 50 条
  • [41] Dataset for multimodal fake news detection and verification tasks
    Bondielli, Alessandro
    Dell'Oglio, Pietro
    Lenci, Alessandro
    Marcelloni, Francesco
    Passaro, Lucia
    DATA IN BRIEF, 2024, 54
  • [42] SGAMF: Sparse Gated Attention-Based Multimodal Fusion Method for Fake News Detection
    Du, Pengfei
    Gao, Yali
    Li, Linghui
    Li, Xiaoyong
    IEEE TRANSACTIONS ON BIG DATA, 2025, 11 (02) : 540 - 552
  • [43] Multimodal Fake News Detection Based on Multi-angle Fusion and Prediction Consistency Optimization
    Fu, Xian
    Zhang, Zhuzhu
    Wu, Tianrui
    Zhang, Ningning
    Zhang, Hui
    Sun, Yu
    PROCEEDINGS OF INTERNATIONAL CONFERENCE ON ALGORITHMS, SOFTWARE ENGINEERING, AND NETWORK SECURITY, ASENS 2024, 2024, : 597 - 602
  • [44] MVAE: Multimodal Variational Autoencoder for Fake News Detection
    Khattar, Dhruv
    Goud, Jaipal Singh
    Gupta, Manish
    Varma, Vasudeva
    WEB CONFERENCE 2019: PROCEEDINGS OF THE WORLD WIDE WEB CONFERENCE (WWW 2019), 2019, : 2915 - 2921
  • [45] QMFND: A quantum multimodal fusion-based fake news detection model for social media
    Qu, Zhiguo
    Meng, Yunyi
    Muhammad, Ghulam
    Tiwari, Prayag
    INFORMATION FUSION, 2024, 104
  • [46] Amharic Fake News Detection on Social Media Using Feature Fusion
    Worku, Menbere Hailu
    Woldeyohannis, Michael Melese
    Lecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering, LNICST, 2022, 411 LNICST : 468 - 479
  • [47] Detecting fake news by exploring the consistency of multimodal data
    Xue, Junxiao
    Wang, Yabo
    Tian, Yichen
    Li, Yafei
    Shi, Lei
    Wei, Lin
    INFORMATION PROCESSING & MANAGEMENT, 2021, 58 (05)
  • [48] A Multimodal Fake News Detection Model Leveraging Image Frequency and Spatial Domain Analysis with Deep Dynamic Trade-Off Fusion
    Zhang, Zhuzhu
    Fu, Xian
    Wu, Tianrui
    Sun, Yu
    Zhang, Ningning
    Zhang, Hui
    PATTERN RECOGNITION AND COMPUTER VISION, PT V, PRCV 2024, 2025, 15035 : 395 - 409
  • [49] Multimodal fake news detection through data augmentation-based contrastive learning
    Hua, Jiaheng
    Cui, Xiaodong
    Li, Xianghua
    Tang, Keke
    Zhu, Peican
    APPLIED SOFT COMPUTING, 2023, 136
  • [50] Uni-Modal Event-Agnostic Knowledge Distillation for Multimodal Fake News Detection
    Liu, Guofan
    Zhang, Jinghao
    Liu, Qiang
    Wu, Junfei
    Wu, Shu
    Wang, Liang
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2024, 36 (12) : 9490 - 9503