Emotion Intensity Detection in Online Media: An Attention Mechanism Based Multimodal Deep Learning Approach

被引:0
|
作者
Chai, Yuanchen [1 ]
机构
[1] Sunshine Ruizhi Secur Consulting Beijing Co LTD, Beijing 100081, Peoples R China
来源
TEHNICKI VJESNIK-TECHNICAL GAZETTE | 2024年 / 31卷 / 02期
关键词
attention mechanism; emotion detection; multimodal; online media; NETWORK;
D O I
10.17559/TV-20230628001154
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
With the increasing influence of online public opinion, mining opinions and trend analysis from massive data of online media is important for understanding user sentiment, managing brand reputation, analyzing public opinion and optimizing marketing strategies. By combining data from multiple perceptual modalities, more comprehensive and accurate sentiment analysis results can be obtained. However, using multimodal data for sentiment analysis may face challenges such as data fusion, modal imbalance and inter -modal correlation. To overcome these challenges, the paper introduces an attention mechanism to multimodal sentiment analysis by constructing text, image, and audio feature extractors and using a custom cross -modal attention layer to compute the attention weights between different modalities, and finally fusing the attention -weighted features for sentiment classification. Through the cross -modal attention mechanism, the model can automatically learn the correlation between different modalities, dynamically adjust the modal weights, and selectively fuse features from different modalities, thus improving the accuracy and expressiveness of sentiment analysis.
引用
收藏
页码:587 / 595
页数:9
相关论文
共 50 条
  • [11] A Deep Learning Method Based on the Attention Mechanism for Hardware Trojan Detection
    Tang, Wenjing
    Su, Jing
    He, Jiaji
    Gao, Yuchan
    ELECTRONICS, 2022, 11 (15)
  • [12] Detecting rumors in social media using emotion based deep learning approach
    Sharma, Drishti
    Srivastava, Abhishek
    PEERJ COMPUTER SCIENCE, 2024, 10
  • [13] A review of multimodal-based emotion recognition techniques for cyberbullying detection in online social media platforms
    Wang, Shuai
    Shibghatullah, Abdul Samad
    Iqbal, Thirupattur Javid
    Keoy, Kay Hooi
    Neural Computing and Applications, 2024, 36 (35) : 21923 - 21956
  • [14] Online Process Phase Detection Using Multimodal Deep Learning
    Li, Xinyu
    Zhang, Yanyi
    Li, Mengzhu
    Chen, Shuhong
    Austin, Farneth R.
    Marsic, Ivan
    Burd, Randall S.
    2016 IEEE 7TH ANNUAL UBIQUITOUS COMPUTING, ELECTRONICS MOBILE COMMUNICATION CONFERENCE (UEMCON), 2016,
  • [15] Multimodal Emotion Recognition Using Deep Generalized Canonical Correlation Analysis with an Attention Mechanism
    Lan, Yu-Ting
    Liu, Wei
    Lu, Bao-Liang
    2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2020,
  • [16] DeepFPD: Browser Fingerprinting Detection via Deep Learning With Multimodal Learning and Attention
    Qiang, Weizhong
    Ren, Kunlun
    Wu, Yueming
    Zou, Deqing
    Jin, Hai
    IEEE TRANSACTIONS ON RELIABILITY, 2024, 73 (03) : 1516 - 1528
  • [17] A Review on Speech Emotion Recognition Using Deep Learning and Attention Mechanism
    Lieskovska, Eva
    Jakubec, Maros
    Jarina, Roman
    Chmulik, Michal
    ELECTRONICS, 2021, 10 (10)
  • [18] A multimodal approach using deep learning for fall detection
    Galvao, Yves M.
    Ferreira, Janderson
    Albuquerque, Vinicius A.
    Barros, Pablo
    Fernandes, Bruno J. T.
    EXPERT SYSTEMS WITH APPLICATIONS, 2021, 168
  • [19] ZeekFlow: Deep Learning-Based Network Intrusion Detection a Multimodal Approach
    Giagkos, Dimitrios
    Kompougias, Orestis
    Litke, Antonis
    Papadakis, Nikolaos
    COMPUTER SECURITY. ESORICS 2023 INTERNATIONAL WORKSHOPS, CPS4CIP, PT II, 2024, 14399 : 409 - 425
  • [20] Automatic Detection of Ocean Eddy based on Deep Learning Technique with Attention Mechanism
    Saida, Shaik John
    Ari, Samit
    2022 NATIONAL CONFERENCE ON COMMUNICATIONS (NCC), 2022, : 302 - 307