Zero-Shot Rumor Detection via Meta Multi-Task Prompt Learning

被引:0
|
作者
Shi, Yu [1 ]
Yu, Ning [1 ]
Sun, Yawei [1 ]
Liu, Jianyi [2 ]
机构
[1] Key Laboratory of Trustworthy Distributed Computing and Service, Ministry of Education, Beijing University of Posts and Telecommunications, Beijing,100876, China
[2] School of Cyberspace Security, Beijing University of Posts and Telecommunications, Beijing,100876, China
关键词
Adversarial machine learning - Contrastive Learning - Learning systems - Multi-task learning;
D O I
10.13190/j.jbupt.2023-270
中图分类号
学科分类号
摘要
To address the issue of the vast amount of memory usage associated with fine-tuning large language models in existing rumor detection methods, and to tackle the sensitivity of prompt learning to its initial point, a meta multi-task prompt learning method for zero-shot rumor detection is proposed. First, the objective of the zero-shot rumor detection task objective is modified based on the prompt learning, and the prompt template is designed to make its task objective align with the training task objective of large language models, fully leveraging the prior knowledge accumulated by large language models. Second, the parameter update strategy based on meta-learning is employed to rapidly identify suitable initial points of the prompt template for zero-shot rumor detection, and the meta-knowledge is learned from different meta-tasks to achieve parameter optimization. Finally, sentiment analysis is introduced as an auxiliary meta-task to further model parameter optimization. Extensive experiments conducted on real-world datasets demonstrate that the proposed model outperforms baseline methods in zero-shot rumor detection tasks, achieving the best performance across various metrics. © 2024 Beijing University of Posts and Telecommunications. All rights reserved.
引用
收藏
页码:77 / 82
相关论文
共 50 条
  • [21] Zero-Shot Stance Detection via Contrastive Learning
    Liang, Bin
    Chen, Zixiao
    Gui, Lin
    He, Yulan
    Yang, Min
    Xu, Ruifeng
    PROCEEDINGS OF THE ACM WEB CONFERENCE 2022 (WWW'22), 2022, : 2738 - 2747
  • [22] Hierarchical Prompt Tuning for Few-Shot Multi-Task Learning
    Liu, Jingping
    Chen, Tao
    Liang, Zujie
    Jiang, Haiyun
    Xiao, Yanghua
    Wei, Feng
    Qian, Yuxi
    Hao, Zhenghong
    Han, Bing
    PROCEEDINGS OF THE 32ND ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, CIKM 2023, 2023, : 1556 - 1565
  • [23] Hierarchical Prompt Learning for Compositional Zero-Shot Recognition
    Wang, Henan
    Yang, Muli
    Wei, Kun
    Deng, Cheng
    PROCEEDINGS OF THE THIRTY-SECOND INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2023, 2023, : 1470 - 1478
  • [24] Zero-Shot Transfer Learning of a Throwing Task via Domain Randomization
    Park, Sungyong
    Kim, Jigang
    Kim, H. Jin
    2020 20TH INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION AND SYSTEMS (ICCAS), 2020, : 1026 - 1030
  • [25] Towards Zero-Shot Conditional Summarization with Adaptive Multi-Task Fine-Tuning
    Goodwin, Travis R.
    Savery, Max E.
    Demner-Fushman, Dina
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, EMNLP 2020, 2020,
  • [26] Zero-shot Multi-task Cough Sound Analysis with Speech Foundation Model Embeddings
    Laska, Brady
    Xi, Pengcheng
    Valdes, Julio J.
    Wallace, Bruce
    Goubran, Rafik
    2024 IEEE INTERNATIONAL SYMPOSIUM ON MEDICAL MEASUREMENTS AND APPLICATIONS, MEMEA 2024, 2024,
  • [27] Zero-Shot Learning for Intrusion Detection via Attribute Representation
    Li, Zhipeng
    Qin, Zheng
    Shen, Pengbo
    Jiang, Liu
    NEURAL INFORMATION PROCESSING (ICONIP 2019), PT I, 2019, 11953 : 352 - 364
  • [28] Hierarchical Prompt Learning for Multi-Task Learning
    Liu, Yajing
    Lu, Yuning
    Liu, Hao
    An, Yaozu
    Xu, Zhuoran
    Yao, Zhuokun
    Zhang, Baofeng
    Xiong, Zhiwei
    Gui, Chenguang
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 10888 - 10898
  • [29] Exploiting multi-scale contextual prompt learning for zero-shot semantic segmentation☆
    Wang, Yiqi
    Tian, Yingjie
    DISPLAYS, 2024, 81
  • [30] Zero-shot Generative Model Adaptation via Image-specific Prompt Learning
    Guo, Jiayi
    Wang, Chaofei
    Wu, You
    Zhang, Eric
    Wang, Kai
    Xu, Xingqian
    Song, Shiji
    Shi, Humphrey
    Huang, Gao
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 11494 - 11503