AMAE: Adversarial multimodal auto-encoder for crisis-related tweet analysis

被引:2
|
作者
Lv, Jiandong [1 ]
Wang, Xingang [1 ]
Shao, Cuiling [1 ]
机构
[1] Qilu Univ Technol, Sch Comp Sci & Technol, Shandong Acad Sci, 3501 Daxue Rd, Jinan 250300, Peoples R China
关键词
Adversarial; Social media; Multi-modal fusion; Situational awareness; SOCIAL MEDIA; FAKE NEWS; DISASTER;
D O I
10.1007/s00607-022-01098-x
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Social media platforms have grown in importance as sources of information and as a complement to traditional media. If informative and relevant tweets on social media platforms can be effectively detected and analyzed during crisis events, it will help humanitarian organizations with situational awareness and planning relief activities. In this work, we propose an adversarial multimodal auto-encoder model for detecting and analyzing crisis-related tweets, which analyzes the complex multimodal content of tweets and integrates adversarial strategies to generate a joint representation containing information from multiple sources. Through extensive experiments on real datasets, we demonstrate the superior performance of the proposed model.
引用
收藏
页码:13 / 28
页数:16
相关论文
共 50 条
  • [21] Multimodal Emotion Recognition Method Based on Convolutional Auto-Encoder
    Zhou, Jian
    Wei, Xianwei
    Cheng, Chunling
    Yang, Qidong
    Li, Qun
    INTERNATIONAL JOURNAL OF COMPUTATIONAL INTELLIGENCE SYSTEMS, 2019, 12 (01) : 351 - 358
  • [22] Multimodal Emotion Recognition Method Based on Convolutional Auto-Encoder
    Jian Zhou
    Xianwei Wei
    Chunling Cheng
    Qidong Yang
    Qun Li
    International Journal of Computational Intelligence Systems, 2018, 12 (1) : 351 - 358
  • [23] The Depression of Noises in Acoustic Signals of Transformer Based on Adversarial Auto-encoder
    Li, Guowei
    Wang, Junbo
    Tang, Qi
    Li, Xiaolong
    Li, Zhijing
    Xie, Zhiyang
    Ma, Jiaqi
    Wang, Fenghua
    2022 IEEE/IAS INDUSTRIAL AND COMMERCIAL POWER SYSTEM ASIA (I&CPS ASIA 2022), 2022, : 941 - 945
  • [24] Collaborative and adversarial deep transfer auto-encoder for intelligent fault diagnosis
    Ma, Yulin
    Yang, Jun
    Li, Lei
    NEUROCOMPUTING, 2022, 486 : 1 - 15
  • [25] Learning to Confuse: Generating Training Time Adversarial Data with Auto-Encoder
    Feng, Ji
    Cai, Qi-Zhi
    Zhou, Zhi-Hua
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), 2019, 32
  • [26] Brain Lesion Synthesis via Progressive Adversarial Variational Auto-Encoder
    Huo, Jiayu
    Vakharia, Vejay
    Wu, Chengyuan
    Sharan, Ashwini
    Ko, Andrew
    Ourselin, Sebastien
    Sparks, Rachel
    SIMULATION AND SYNTHESIS IN MEDICAL IMAGING, SASHIMI 2022, 2022, 13570 : 101 - 111
  • [27] Differentially Private Adversarial Auto-Encoder to Protect Gender in Voice Biometrics
    Chouchane, Oubaida
    Panariello, Michele
    Zari, Oualid
    Kerenciler, Ismet
    Chihaoui, Imen
    Todisco, Massimiliano
    Onen, Melek
    PROCEEDINGS OF THE 2023 ACM WORKSHOP ON INFORMATION HIDING AND MULTIMEDIA SECURITY, IH&MMSEC 2023, 2023, : 127 - 132
  • [28] Data Fused Motor Fault Identification Based on Adversarial Auto-Encoder
    Wang, Botao
    Shen, Chuanwen
    Yu, Chenxi
    Yang, Yutao
    2019 IEEE 10TH INTERNATIONAL SYMPOSIUM ON POWER ELECTRONICS FOR DISTRIBUTED GENERATION SYSTEMS (PEDG 2019), 2019, : 299 - 305
  • [29] Auto-encoder based Cognitive Analysis of Questionnary
    Akay, Simge
    Korkmaz, Hande
    Arica, Nafiz
    2018 26TH SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE (SIU), 2018,
  • [30] PRPD data analysis with Auto-Encoder Network
    Li, Songyuan
    Man, Yuyan
    Zhang, Chi
    Fang, Qiong
    Li, Suya
    Deng, Min
    1ST INTERNATIONAL SYMPOSIUM ON WATER RESOURCE AND ENVIRONMENTAL MANAGEMENT (WREM 2018), 2019, 81