Few-shot Learning for Multi-modal Social Media Event Filtering

被引:3
|
作者
Nascimento, Jose [1 ]
Cardenuto, Joao Phillipe [1 ]
Yang, Jing [1 ]
Rocha, Anderson [1 ]
机构
[1] Univ Estadual Campinas, Inst Comp, Artificial Intelligence Lab Recod Ai, Campinas, SP, Brazil
来源
2022 IEEE INTERNATIONAL WORKSHOP ON INFORMATION FORENSICS AND SECURITY (WIFS) | 2022年
基金
巴西圣保罗研究基金会; 瑞典研究理事会;
关键词
event filtering; few-shot learning; social media dataset;
D O I
10.1109/WIFS55849.2022.9975429
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Social media has become an important data source for event analysis. When collecting this type of data, most contain no useful information to a target event. Thus, it is essential to filter out those noisy data at the earliest opportunity for a human expert to perform further inspection. Most existing solutions for event filtering rely on fully supervised methods for training. However, in many real-world scenarios, having access to large number of labeled samples is not possible. To deal with a few labeled sample training problem for event filtering, we propose a graph-based few-shot learning pipeline. We also release the Brazilian Protest Dataset to test our method. To the best of our knowledge, this dataset is the first of its kind in event filtering that focuses on protests in multi-modal social media data, with most of the text in Portuguese. Our experimental results show that our proposed pipeline has comparable performance with only a few labeled samples (60) compared with a fully labeled dataset (3100). To facilitate the research community, we make our dataset and code available at https://github.com/jdnascim/7Set-AL.
引用
收藏
页数:6
相关论文
共 50 条
  • [1] DISCRIMINATIVE HALLUCINATION FOR MULTI-MODAL FEW-SHOT LEARNING
    Pahde, Frederik
    Nabi, Moin
    Klein, Tassilo
    Jaehnichen, Patrick
    2018 25TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2018, : 156 - 160
  • [2] Few-shot adaptation of multi-modal foundation models: a survey
    Liu, Fan
    Zhang, Tianshu
    Dai, Wenwen
    Zhang, Chuanyi
    Cai, Wenwen
    Zhou, Xiaocong
    Chen, Delong
    ARTIFICIAL INTELLIGENCE REVIEW, 2024, 57 (10)
  • [3] Few-shot multi-modal registration with mono-modal knowledge transfer
    Wang, Peng
    Guo, Yi
    Wang, Yuanyuan
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2023, 85
  • [4] An Adaptive Dual-channel Multi-modal graph neural network for few-shot learning
    Yang, Jieyi
    Dong, Yihong
    Li, Guoqing
    KNOWLEDGE-BASED SYSTEMS, 2025, 310
  • [5] Text generation and multi-modal knowledge transfer for few-shot object detection
    Du, Yaoyang
    Liu, Fang
    Jiao, Licheng
    Li, Shuo
    Hao, Zehua
    Li, Pengfang
    Wang, Jiahao
    Wang, Hao
    Liu, Xu
    PATTERN RECOGNITION, 2025, 161
  • [6] A Few-Shot Modulation Recognition Method Based on Multi-Modal Feature Fusion
    Zha, Yanping
    Wang, Hongjun
    Shen, Zhexian
    Wang, Jiangzhou
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2024, 73 (07) : 10823 - 10828
  • [7] Multi-Modal Prototypes for Few-Shot Object Detection in Remote Sensing Images
    Liu, Yanxing
    Pan, Zongxu
    Yang, Jianwei
    Zhou, Peiling
    Zhang, Bingchen
    REMOTE SENSING, 2024, 16 (24)
  • [8] MULTIFORM: Few-Shot Knowledge Graph Completion via Multi-modal Contexts
    Zhang, Xuan
    Liang, Xun
    Zheng, Xiangping
    Wu, Bo
    Guo, Yuhui
    MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, ECML PKDD 2022, PT II, 2023, 13714 : 172 - 187
  • [9] Attention-optimized vision-enhanced prompt learning for few-shot multi-modal sentiment analysis
    Zhou, Zikai
    Qiao, Baiyou
    Feng, Haisong
    Han, Donghong
    Wu, Gang
    Neural Computing and Applications, 2024, 36 (33) : 21091 - 21105
  • [10] Enhancing Few-Shot Multi-modal Fake News Detection Through Adaptive Fusion
    Ouyang, Qiang
    Lin, Nankai
    Zhou, Yongmei
    Yang, Aimin
    Zhou, Dong
    WEB AND BIG DATA, APWEB-WAIM 2024, PT IV, 2024, 14964 : 432 - 447