On the Integration of Social Context for Enhanced Fake News Detection Using Multimodal Fusion Attention Mechanism

被引:0
|
作者
Dellys, Hachemi Nabil [1 ]
Mokeddem, Halima [1 ]
Sliman, Layth [2 ]
机构
[1] Ecole Natl Super Informat, Lab Methodes Concept Syst, BP 68M, Algiers 16309, Algeria
[2] Pantheon Assas Univ, Efrei Res Lab, 32 Rue republ Villeju, F-94800 Paris, France
关键词
fake news detection; multi-modal features fusion; feedforward neural network; one-dimensional convolutional neural network; support vector machine; vision-and-language bidirectional encoder representations from transformers; synthetic minority oversampling technique;
D O I
10.3390/ai6040078
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Detecting fake news has become a critical challenge in today's information-dense society. Existing research on fake news detection predominantly emphasizes multi-modal approaches, focusing primarily on textual and visual features. However, despite its clear importance, the integration of social context has received limited attention in the literature. To address this gap, this study proposes a novel three-dimensional multimodal fusion framework that integrates textual, visual, and social context features for effective fake news detection on social media platforms. The proposed methodology leverages an advanced Vision-and-Language Bidirectional Encoder Representations from Transformers multi-task model to extract fused attention features from text and images concurrently, capturing intricate inter-modal correlations. Comprehensive experiments validate the efficacy of the proposed approach. The results demonstrate that the proposed solution achieves the highest balanced accuracy of 77%, surpassing other baseline models. Furthermore, the incorporation of social context features significantly enhances model performance. The proposed multimodal architecture also outperforms state-of-the-art approaches, providing a robust and scalable framework for fake news detection using artificial intelligence. This study contributes to advancing the field by offering a comprehensive and practical engineering solution for combating fake news.
引用
收藏
页数:30
相关论文
共 50 条
  • [1] Multimodal Fusion with BERT and Attention Mechanism for Fake News Detection
    Nguyen Manh Duc Tuan
    Pham Quang Nhat Minh
    2021 RIVF INTERNATIONAL CONFERENCE ON COMPUTING AND COMMUNICATION TECHNOLOGIES (RIVF 2021), 2021, : 43 - 48
  • [2] A mutual attention based multimodal fusion for fake news detection on social network
    Guo, Ying
    APPLIED INTELLIGENCE, 2023, 53 (12) : 15311 - 15320
  • [3] A mutual attention based multimodal fusion for fake news detection on social network
    Ying Guo
    Applied Intelligence, 2023, 53 : 15311 - 15320
  • [4] Semantic-enhanced multimodal fusion network for fake news detection
    Li, Shuo
    Yao, Tao
    Li, Saifei
    Yan, Lianshan
    INTERNATIONAL JOURNAL OF INTELLIGENT SYSTEMS, 2022, 37 (12) : 12235 - 12251
  • [5] Text-image multimodal fusion model for enhanced fake news detection
    Lin, Szu-Yin
    Chen, Yen-Chiu
    Chang, Yu-Han
    Lo, Shih-Hsin
    Chao, Kuo-Ming
    SCIENCE PROGRESS, 2024, 107 (04)
  • [6] Multimodal Data Fusion Framework For Fake News Detection
    Athira, A. B.
    Tiwari, Abhishek
    Kumar, S. D. Madhu
    Chacko, Anu Mary
    2022 IEEE 19TH INDIA COUNCIL INTERNATIONAL CONFERENCE, INDICON, 2022,
  • [7] SGAMF: Sparse Gated Attention-Based Multimodal Fusion Method for Fake News Detection
    Du, Pengfei
    Gao, Yali
    Li, Linghui
    Li, Xiaoyong
    IEEE TRANSACTIONS ON BIG DATA, 2025, 11 (02) : 540 - 552
  • [8] MRDCA: a multimodal approach for fine-grained fake news detection through integration of RoBERTa and DenseNet based upon fusion mechanism of co-attention
    Qian, Lingfei
    Xu, Ruipeng
    Zhou, Zhipeng
    ANNALS OF OPERATIONS RESEARCH, 2022, 348 (1) : 257 - 278
  • [9] A two-branch multimodal fake news detection model based on multimodal bilinear pooling and attention mechanism
    Guo, Ying
    Ge, Hong
    Li, Jinhong
    FRONTIERS IN COMPUTER SCIENCE, 2023, 5
  • [10] Potential Features Fusion Network for Multimodal Fake News Detection
    Kou, Feifei
    Wang, Bingwei
    Li, Haisheng
    Zhu, Chuangying
    Shi, Lei
    Zhang, Jiwei
    Qi, Limei
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2025, 21 (03)