On the Integration of Social Context for Enhanced Fake News Detection Using Multimodal Fusion Attention Mechanism

被引:0
|
作者
Dellys, Hachemi Nabil [1 ]
Mokeddem, Halima [1 ]
Sliman, Layth [2 ]
机构
[1] Ecole Natl Super Informat, Lab Methodes Concept Syst, BP 68M, Algiers 16309, Algeria
[2] Pantheon Assas Univ, Efrei Res Lab, 32 Rue republ Villeju, F-94800 Paris, France
关键词
fake news detection; multi-modal features fusion; feedforward neural network; one-dimensional convolutional neural network; support vector machine; vision-and-language bidirectional encoder representations from transformers; synthetic minority oversampling technique;
D O I
10.3390/ai6040078
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Detecting fake news has become a critical challenge in today's information-dense society. Existing research on fake news detection predominantly emphasizes multi-modal approaches, focusing primarily on textual and visual features. However, despite its clear importance, the integration of social context has received limited attention in the literature. To address this gap, this study proposes a novel three-dimensional multimodal fusion framework that integrates textual, visual, and social context features for effective fake news detection on social media platforms. The proposed methodology leverages an advanced Vision-and-Language Bidirectional Encoder Representations from Transformers multi-task model to extract fused attention features from text and images concurrently, capturing intricate inter-modal correlations. Comprehensive experiments validate the efficacy of the proposed approach. The results demonstrate that the proposed solution achieves the highest balanced accuracy of 77%, surpassing other baseline models. Furthermore, the incorporation of social context features significantly enhances model performance. The proposed multimodal architecture also outperforms state-of-the-art approaches, providing a robust and scalable framework for fake news detection using artificial intelligence. This study contributes to advancing the field by offering a comprehensive and practical engineering solution for combating fake news.
引用
收藏
页数:30
相关论文
共 50 条
  • [21] MRAN: Multimodal relationship-aware attention network for fake news detection
    Yang, Hongyu
    Zhang, Jinjiao
    Zhang, Liang
    Cheng, Xiang
    Hu, Ze
    COMPUTER STANDARDS & INTERFACES, 2024, 89
  • [22] Temporal Enhanced Multimodal Graph Neural Networks for Fake News Detection
    Qu, Zhibo
    Zhou, Fuhui
    Song, Xi
    Ding, Rui
    Yuan, Lu
    Wu, Qihui
    IEEE TRANSACTIONS ON COMPUTATIONAL SOCIAL SYSTEMS, 2024, 11 (06): : 7286 - 7298
  • [23] Temporal Enhanced Multimodal Graph Neural Networks for Fake News Detection
    Qu, Zhibo
    Zhou, Fuhui
    Song, Xi
    Ding, Rui
    Yuan, Lu
    Wu, Qihui
    IEEE TRANSACTIONS ON COMPUTATIONAL SOCIAL SYSTEMS, 2024, : 1 - 13
  • [24] FMFN: Fine-Grained Multimodal Fusion Networks for Fake News Detection
    Wang, Jingzi
    Mao, Hongyan
    Li, Hongwei
    APPLIED SCIENCES-BASEL, 2022, 12 (03):
  • [25] Escaping the neutralization effect of modality features fusion in multimodal Fake News Detection
    Wang, Bing
    Li, Ximing
    Li, Changchun
    Wang, Shengsheng
    Gao, Wanfu
    INFORMATION FUSION, 2024, 111
  • [26] MDF-FND: A dynamic fusion model for multimodal fake news detection
    Lv, Hongzhen
    Yang, Wenzhong
    Yin, Yabo
    Wei, Fuyuan
    Peng, Jiaren
    Geng, Haokun
    KNOWLEDGE-BASED SYSTEMS, 2025, 317
  • [27] Improving Data Fusion for Fake News Detection: A Hybrid Fusion Approach for Unimodal and Multimodal Data
    Hamed, Suhaib Kh.
    Ab Aziz, Mohd Juzaiddin
    Yaakub, Mohd Ridzwan
    IEEE ACCESS, 2024, 12 : 112412 - 112425
  • [28] Fake News Detection Based on Multimodal Inputs
    Liang, Zhiping
    CMC-COMPUTERS MATERIALS & CONTINUA, 2023, 75 (02): : 4519 - 4534
  • [29] Explainable Detection of Fake News on Social Media Using Pyramidal Co-Attention Network
    Khan, Fazlullah
    Alturki, Ryan
    Srivastava, Gautam
    Gazzawe, Foziah
    Shah, Syed Tauhid Ullah
    Mastorakis, Spyridon
    IEEE TRANSACTIONS ON COMPUTATIONAL SOCIAL SYSTEMS, 2024, 11 (04) : 4574 - 4583
  • [30] Beyond News Contents: The Role of Social Context for Fake New Detection
    Shu, Kai
    Wang, Suhang
    Liu, Huan
    PROCEEDINGS OF THE TWELFTH ACM INTERNATIONAL CONFERENCE ON WEB SEARCH AND DATA MINING (WSDM'19), 2019, : 312 - 320