On the Integration of Social Context for Enhanced Fake News Detection Using Multimodal Fusion Attention Mechanism

被引:0
作者
Dellys, Hachemi Nabil [1 ]
Mokeddem, Halima [1 ]
Sliman, Layth [2 ]
机构
[1] Ecole Natl Super Informat, Lab Methodes Concept Syst, BP 68M, Algiers 16309, Algeria
[2] Pantheon Assas Univ, Efrei Res Lab, 32 Rue republ Villeju, F-94800 Paris, France
关键词
fake news detection; multi-modal features fusion; feedforward neural network; one-dimensional convolutional neural network; support vector machine; vision-and-language bidirectional encoder representations from transformers; synthetic minority oversampling technique;
D O I
10.3390/ai6040078
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Detecting fake news has become a critical challenge in today's information-dense society. Existing research on fake news detection predominantly emphasizes multi-modal approaches, focusing primarily on textual and visual features. However, despite its clear importance, the integration of social context has received limited attention in the literature. To address this gap, this study proposes a novel three-dimensional multimodal fusion framework that integrates textual, visual, and social context features for effective fake news detection on social media platforms. The proposed methodology leverages an advanced Vision-and-Language Bidirectional Encoder Representations from Transformers multi-task model to extract fused attention features from text and images concurrently, capturing intricate inter-modal correlations. Comprehensive experiments validate the efficacy of the proposed approach. The results demonstrate that the proposed solution achieves the highest balanced accuracy of 77%, surpassing other baseline models. Furthermore, the incorporation of social context features significantly enhances model performance. The proposed multimodal architecture also outperforms state-of-the-art approaches, providing a robust and scalable framework for fake news detection using artificial intelligence. This study contributes to advancing the field by offering a comprehensive and practical engineering solution for combating fake news.
引用
收藏
页数:30
相关论文
共 50 条
  • [31] A late fusion framework using whale optimization technique and attention-BiLSTM for fake news detection
    Varalakshmi, K.
    Kumar, P. M. Ashok
    INTERNATIONAL JOURNAL OF DATA SCIENCE AND ANALYTICS, 2024, 18 (03) : 275 - 294
  • [32] Improving Fake News Detection by Using an Entity-enhanced Framework to Fuse Diverse Multimodal Clues
    Qi, Peng
    Cao, Juan
    Li, Xirong
    Liu, Huan
    Sheng, Qiang
    Mi, Xiaoyue
    He, Qin
    Lv, Yongbiao
    Guo, Chenyang
    Yu, Yingchao
    PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 1212 - 1220
  • [33] Exploring Fake News Detection with Heterogeneous Social Media Context Graphs
    Donabauer, Gregor
    Kruschwitz, Udo
    ADVANCES IN INFORMATION RETRIEVAL, ECIR 2023, PT II, 2023, 13981 : 396 - 405
  • [34] CGAR: A Contrastive Graph Attention Residual Network for Enhanced Fake News Detection
    Wang, Chenchen
    Lu, Xingjian
    Wang, Xiaoling
    Qi, Chenhui
    WEB AND BIG DATA, APWEB-WAIM 2024, PT III, 2024, 14963 : 161 - 175
  • [35] A Temporal-and-Spatial Flow Based Multimodal Fake News Detection by Pooling and Attention Blocks
    Guo, Ying
    Song, Wei
    IEEE ACCESS, 2022, 10 : 131498 - 131508
  • [36] Fake News Detection Model with Hybrid Features-News Text, Image, and Social Context
    Lin, Szu-Yin
    Hu, Ya-Han
    Lee, Pei-Ju
    Zeng, Yi-Hua
    Chang, Chi-Min
    Chang, Hsiao-Chuan
    INFORMATION SYSTEMS FRONTIERS, 2025,
  • [37] FAKE NEWS DETECTION BASED ON MULTI-FEATURE FUSION UNDER ATTENTION GUIDANCE
    Peng, Yan
    Wu, Huimin
    Wang, Lei
    Wang, Jie
    JOURNAL OF NONLINEAR AND CONVEX ANALYSIS, 2022, 23 (09)
  • [38] Keywords attention for fake news detection using few positive labels
    de Souza, Mariana Caravanti
    Golo, Marcos Paulo Silva
    Jorge, Alipio Mario Guedes
    de Amorim, Evelin Carvalho Freire
    Campos, Ricardo Nuno Taborda
    Marcacini, Ricardo Marcondes
    Rezende, Solange Oliveira
    INFORMATION SCIENCES, 2024, 663
  • [39] Combating Fake News on Social Media: A Fusion Approach for Improved Detection and Interpretability
    Zamil, Yasmine Khalid
    Charkari, Nasrollah Moghaddam
    IEEE ACCESS, 2024, 12 : 2074 - 2085
  • [40] Multimodal Social Media Fake News Detection Based on Similarity Inference and Adversarial Networks
    Shan, Fangfang
    Sun, Huifang
    Wang, Mengyi
    CMC-COMPUTERS MATERIALS & CONTINUA, 2024, 79 (01): : 581 - 605