On the Integration of Social Context for Enhanced Fake News Detection Using Multimodal Fusion Attention Mechanism

被引:1
作者
Dellys, Hachemi Nabil [1 ]
Mokeddem, Halima [1 ]
Sliman, Layth [2 ]
机构
[1] Ecole Natl Super Informat, Lab Methodes Concept Syst, BP 68M, Algiers 16309, Algeria
[2] Pantheon Assas Univ, Efrei Res Lab, 32 Rue republ Villeju, F-94800 Paris, France
关键词
fake news detection; multi-modal features fusion; feedforward neural network; one-dimensional convolutional neural network; support vector machine; vision-and-language bidirectional encoder representations from transformers; synthetic minority oversampling technique;
D O I
10.3390/ai6040078
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Detecting fake news has become a critical challenge in today's information-dense society. Existing research on fake news detection predominantly emphasizes multi-modal approaches, focusing primarily on textual and visual features. However, despite its clear importance, the integration of social context has received limited attention in the literature. To address this gap, this study proposes a novel three-dimensional multimodal fusion framework that integrates textual, visual, and social context features for effective fake news detection on social media platforms. The proposed methodology leverages an advanced Vision-and-Language Bidirectional Encoder Representations from Transformers multi-task model to extract fused attention features from text and images concurrently, capturing intricate inter-modal correlations. Comprehensive experiments validate the efficacy of the proposed approach. The results demonstrate that the proposed solution achieves the highest balanced accuracy of 77%, surpassing other baseline models. Furthermore, the incorporation of social context features significantly enhances model performance. The proposed multimodal architecture also outperforms state-of-the-art approaches, providing a robust and scalable framework for fake news detection using artificial intelligence. This study contributes to advancing the field by offering a comprehensive and practical engineering solution for combating fake news.
引用
收藏
页数:30
相关论文
共 71 条
[1]   CoAID-DEEP: An Optimized Intelligent Framework for Automated Detecting COVID-19 Misleading Information on Twitter [J].
Abdelminaam, Diaa Salama ;
Ismail, Fatma Helmy ;
Taha, Mohamed ;
Taha, Ahmed ;
Houssein, Essam H. ;
Nabil, Ayman .
IEEE ACCESS, 2021, 9 :27840-27867
[2]   Comparison of Fake News Detection using Machine Learning and Deep Learning Techniques [J].
Alameri, Saeed Amer ;
Mohd, Masnizah .
2021 3RD INTERNATIONAL CYBER RESILIENCE CONFERENCE (CRC), 2021, :101-106
[3]   Machine Learning in Detecting COVID-19 Misinformation on Twitter [J].
Alenezi, Mohammed N. ;
Alqenaei, Zainab M. .
FUTURE INTERNET, 2021, 13 (10)
[4]   Social Media and Fake News in the 2016 Election [J].
Allcott, Hunt ;
Gentzkow, Matthew .
JOURNAL OF ECONOMIC PERSPECTIVES, 2017, 31 (02) :211-235
[5]   An Optimized Hybrid Deep Learning Model to Detect COVID-19 Misleading Information [J].
Alouffi, Bader ;
Alharbi, Abdullah ;
Sahal, Radhya ;
Saleh, Hager .
COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2021, 2021
[6]   Learning Frequency-Aware Cross-Modal Interaction for Multimodal Fake News Detection [J].
Bai, Yan ;
Liu, Yanfeng ;
Li, Yongjun .
IEEE TRANSACTIONS ON COMPUTATIONAL SOCIAL SYSTEMS, 2024, 11 (05) :6568-6579
[7]  
Balshetwar SV, 2023, MULTIMED TOOLS APPL, V82, P35781, DOI 10.1007/s11042-023-14883-3
[8]   Detection of Fake News Text Classification on COVID-19 Using Deep Learning Approaches [J].
Bangyal, Waqas Haider ;
Qasim, Rukhma ;
Rehman, Najeeb Ur ;
Ahmad, Zeeshan ;
Dar, Hafsa ;
Rukhsar, Laiqa ;
Aman, Zahra ;
Ahmad, Jamil .
COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE, 2021, 2021
[9]  
Bondielli A., 2023, P 8 EV CAMP NAT LANG
[10]  
Cao J., 2020, DISINFORMATION MISIN, P141, DOI DOI 10.1007/978-3-030-42699-6_8