On the Integration of Social Context for Enhanced Fake News Detection Using Multimodal Fusion Attention Mechanism

被引:0
作者
Dellys, Hachemi Nabil [1 ]
Mokeddem, Halima [1 ]
Sliman, Layth [2 ]
机构
[1] Ecole Natl Super Informat, Lab Methodes Concept Syst, BP 68M, Algiers 16309, Algeria
[2] Pantheon Assas Univ, Efrei Res Lab, 32 Rue republ Villeju, F-94800 Paris, France
关键词
fake news detection; multi-modal features fusion; feedforward neural network; one-dimensional convolutional neural network; support vector machine; vision-and-language bidirectional encoder representations from transformers; synthetic minority oversampling technique;
D O I
10.3390/ai6040078
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Detecting fake news has become a critical challenge in today's information-dense society. Existing research on fake news detection predominantly emphasizes multi-modal approaches, focusing primarily on textual and visual features. However, despite its clear importance, the integration of social context has received limited attention in the literature. To address this gap, this study proposes a novel three-dimensional multimodal fusion framework that integrates textual, visual, and social context features for effective fake news detection on social media platforms. The proposed methodology leverages an advanced Vision-and-Language Bidirectional Encoder Representations from Transformers multi-task model to extract fused attention features from text and images concurrently, capturing intricate inter-modal correlations. Comprehensive experiments validate the efficacy of the proposed approach. The results demonstrate that the proposed solution achieves the highest balanced accuracy of 77%, surpassing other baseline models. Furthermore, the incorporation of social context features significantly enhances model performance. The proposed multimodal architecture also outperforms state-of-the-art approaches, providing a robust and scalable framework for fake news detection using artificial intelligence. This study contributes to advancing the field by offering a comprehensive and practical engineering solution for combating fake news.
引用
收藏
页数:30
相关论文
共 50 条
  • [41] Multimodal Fake News Detection Based on Multi-angle Fusion and Prediction Consistency Optimization
    Fu, Xian
    Zhang, Zhuzhu
    Wu, Tianrui
    Zhang, Ningning
    Zhang, Hui
    Sun, Yu
    PROCEEDINGS OF INTERNATIONAL CONFERENCE ON ALGORITHMS, SOFTWARE ENGINEERING, AND NETWORK SECURITY, ASENS 2024, 2024, : 597 - 602
  • [42] MVAE: Multimodal Variational Autoencoder for Fake News Detection
    Khattar, Dhruv
    Goud, Jaipal Singh
    Gupta, Manish
    Varma, Vasudeva
    WEB CONFERENCE 2019: PROCEEDINGS OF THE WORLD WIDE WEB CONFERENCE (WWW 2019), 2019, : 2915 - 2921
  • [43] A Multimodal Knowledge Representation Method for Fake News Detection
    Zeng, Fanhao
    Yao, Jiaxin
    Xu, Yijie
    Liu, Yanhua
    2024 4TH INTERNATIONAL CONFERENCE ON COMPUTER, CONTROL AND ROBOTICS, ICCCR 2024, 2024, : 360 - 364
  • [44] SEPM: Multiscale semantic enhancement-progressive multimodal fusion network for fake news detection
    Wang, Hui
    Guo, Junfeng
    Liu, Shouxin
    Chen, Pengbing
    Li, Xiaowei
    EXPERT SYSTEMS WITH APPLICATIONS, 2025, 283
  • [45] Fake News Detection on Social Media Using Ensemble Methods
    Ilyas, Muhammad Ali
    Rehman, Abdul
    Abbas, Assad
    Kim, Dongsun
    Naseem, Muhammad Tahir
    Allah, Nasro Min
    CMC-COMPUTERS MATERIALS & CONTINUA, 2024, 81 (03): : 4525 - 4549
  • [46] Multimodal fake news detection using a Cultural Algorithm with situational and normative knowledge
    Shah, Priyanshi
    Kobti, Ziad
    2020 IEEE CONGRESS ON EVOLUTIONARY COMPUTATION (CEC), 2020,
  • [47] MVAN: Multi-View Attention Networks for Fake News Detection on Social Media
    Ni, Shiwen
    Li, Jiawen
    Kao, Hung-Yu
    IEEE ACCESS, 2021, 9 : 106907 - 106917
  • [48] User-Characteristic Enhanced Model for Fake News Detection in Social Media
    Jiang, Shengyi
    Chen, Xiaoting
    Zhang, Liming
    Chen, Sutong
    Liu, Haonan
    NATURAL LANGUAGE PROCESSING AND CHINESE COMPUTING (NLPCC 2019), PT I, 2019, 11838 : 634 - 646
  • [49] A multimodal fake news detection model based on crossmodal attention residual and multichannel convolutional neural networks
    Song, Chenguang
    Ning, Nianwen
    Zhang, Yunlei
    Wu, Bin
    INFORMATION PROCESSING & MANAGEMENT, 2021, 58 (01)
  • [50] Attention-Based Deep Learning Models for Detection of Fake News in Social Networks
    Ramya S.P.
    Eswari R.
    International Journal of Cognitive Informatics and Natural Intelligence, 2021, 15 (04)