Effective fake news video detection using domain knowledge and multimodal data fusion on youtube

被引:23
|
作者
Choi, Hyewon [1 ]
Ko, Youngjoong [1 ]
机构
[1] Sungkyunkwan Univ, Dept Comp Sci & Engn, 2066 Seobu Ro, Suwon, Gyeonggi Do, South Korea
基金
新加坡国家研究基金会;
关键词
Fake news video detection; Domain knowledge; Multimodal data; Deep neural networks;
D O I
10.1016/j.patrec.2022.01.007
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In the digital age, numerous videos are being actively produced and uploaded online. Simultaneously, fake news videos to attract public attention are also on the rise. Therefore, intensive research is being conducted to detect them. Validating video content is critical for all users as the public is exposed to various fake news videos. This study proposes ways to detect fake news videos effectively using domain knowledge and multimodal data fusion. We use domain knowledge to perform learning by reflecting the potential meaning of comments, helping us detecting fake news videos. We also use the linear combination to efficiently adjust the encoding rate for each characteristic of the video and effectively detect fake news videos. In particular, the domain knowledge improves the model performance by approximately 3% for all test datasets. Consequently, we achieve an F1-score of 0.93, which is higher than those of other comparison models in all the test datasets.(c) 2022 Elsevier B.V. All rights reserved.
引用
收藏
页码:44 / 52
页数:9
相关论文
共 50 条
  • [1] Multimodal Data Fusion Framework For Fake News Detection
    Athira, A. B.
    Tiwari, Abhishek
    Kumar, S. D. Madhu
    Chacko, Anu Mary
    2022 IEEE 19TH INDIA COUNCIL INTERNATIONAL CONFERENCE, INDICON, 2022,
  • [2] Improving Data Fusion for Fake News Detection: A Hybrid Fusion Approach for Unimodal and Multimodal Data
    Hamed, Suhaib Kh.
    Ab Aziz, Mohd Juzaiddin
    Yaakub, Mohd Ridzwan
    IEEE ACCESS, 2024, 12 : 112412 - 112425
  • [3] Multimodal Feature Adaptive Fusion for Fake News Detection
    Wang, Teng
    Zhang, Dawei
    Wang, Liqin
    Dong, Yongfeng
    Computer Engineering and Applications, 2024, 60 (13) : 102 - 111
  • [4] A Multimodal Knowledge Representation Method for Fake News Detection
    Zeng, Fanhao
    Yao, Jiaxin
    Xu, Yijie
    Liu, Yanhua
    2024 4TH INTERNATIONAL CONFERENCE ON COMPUTER, CONTROL AND ROBOTICS, ICCCR 2024, 2024, : 360 - 364
  • [5] Multimodal fake news detection using a Cultural Algorithm with situational and normative knowledge
    Shah, Priyanshi
    Kobti, Ziad
    2020 IEEE CONGRESS ON EVOLUTIONARY COMPUTATION (CEC), 2020,
  • [6] Multimodal Fusion with BERT and Attention Mechanism for Fake News Detection
    Nguyen Manh Duc Tuan
    Pham Quang Nhat Minh
    2021 RIVF INTERNATIONAL CONFERENCE ON COMPUTING AND COMMUNICATION TECHNOLOGIES (RIVF 2021), 2021, : 43 - 48
  • [7] Potential Features Fusion Network for Multimodal Fake News Detection
    Kou, Feifei
    Wang, Bingwei
    Li, Haisheng
    Zhu, Chuangying
    Shi, Lei
    Zhang, Jiwei
    Qi, Limei
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2025, 21 (03)
  • [8] Multimodal fake news detection via progressive fusion networks
    Jing, Jing
    Wu, Hongchen
    Sun, Jie
    Fang, Xiaochang
    Zhang, Huaxiang
    INFORMATION PROCESSING & MANAGEMENT, 2023, 60 (01)
  • [9] Multimodal Fake News Detection
    Segura-Bedmar, Isabel
    Alonso-Bartolome, Santiago
    INFORMATION, 2022, 13 (06)
  • [10] Reinforced Adaptive Knowledge Learning for Multimodal Fake News Detection
    Zhang, Litian
    Zhang, Xiaoming
    Zhou, Ziyi
    Huang, Feiran
    Li, Chaozhuo
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 15, 2024, : 16777 - 16785