AMAE: Adversarial multimodal auto-encoder for crisis-related tweet analysis

被引:2
|
作者
Lv, Jiandong [1 ]
Wang, Xingang [1 ]
Shao, Cuiling [1 ]
机构
[1] Qilu Univ Technol, Sch Comp Sci & Technol, Shandong Acad Sci, 3501 Daxue Rd, Jinan 250300, Peoples R China
关键词
Adversarial; Social media; Multi-modal fusion; Situational awareness; SOCIAL MEDIA; FAKE NEWS; DISASTER;
D O I
10.1007/s00607-022-01098-x
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Social media platforms have grown in importance as sources of information and as a complement to traditional media. If informative and relevant tweets on social media platforms can be effectively detected and analyzed during crisis events, it will help humanitarian organizations with situational awareness and planning relief activities. In this work, we propose an adversarial multimodal auto-encoder model for detecting and analyzing crisis-related tweets, which analyzes the complex multimodal content of tweets and integrates adversarial strategies to generate a joint representation containing information from multiple sources. Through extensive experiments on real datasets, we demonstrate the superior performance of the proposed model.
引用
收藏
页码:13 / 28
页数:16
相关论文
共 50 条
  • [1] AMAE: Adversarial multimodal auto-encoder for crisis-related tweet analysis
    Jiandong Lv
    Xingang Wang
    Cuiling Shao
    Computing, 2023, 105 : 13 - 28
  • [2] Auto-encoder generative adversarial networks
    Zhai, Zhonghua
    JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2018, 35 (03) : 3043 - 3049
  • [3] Conceptual Representation for Crisis-Related Tweet Classification
    Choi, Won-Gyu
    Lee, Kyung-Soon
    COMPUTACION Y SISTEMAS, 2019, 23 (04): : 1523 - 1531
  • [4] Disentangled variational auto-encoder for multimodal fusion performance analysis in multimodal sentiment analysis
    Chen, Rongfei
    Zhou, Wenju
    Hu, Huosheng
    Fei, Zixiang
    Fei, Minrui
    Zhou, Hao
    KNOWLEDGE-BASED SYSTEMS, 2024, 301
  • [5] Coupled generative adversarial stacked Auto-encoder: CoGASA
    Kiasari, Mohammad Ahangar
    Moirangthem, Dennis Singh
    Lee, Minho
    NEURAL NETWORKS, 2018, 100 : 1 - 9
  • [6] Adversarial auto-encoder for rating prediction with ratings and reviews
    Yi, Jin
    Huang, Jiajin
    Qin, Jin
    WEB INTELLIGENCE, 2020, 18 (04) : 285 - 294
  • [7] Adversarial auto-encoder for unsupervised deep domain adaptation
    Shao, Rui
    Lan, Xiangyuan
    IET IMAGE PROCESSING, 2019, 13 (14) : 2772 - 2777
  • [8] A Novel Fault Detection Method Based on Adversarial Auto-Encoder
    Wang Jian
    Han Zhiyan
    PROCEEDINGS OF THE 39TH CHINESE CONTROL CONFERENCE, 2020, : 4166 - 4170
  • [9] Adversarial Collaborative Auto-encoder for Top-N Recommendation
    Yuan, Feng
    Yao, Lina
    Benatallah, Boualem
    2019 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2019,
  • [10] Unsupervised deep feature representation using adversarial auto-encoder
    Cai, Jinyu
    Wang, Shiping
    Guo, Wenzhong
    2019 IEEE INTERNATIONAL CONFERENCE ON INDUSTRIAL CYBER PHYSICAL SYSTEMS (ICPS 2019), 2019, : 749 - 754