Zero-Shot Rumor Detection via Meta Multi-Task Prompt Learning

被引:0
|
作者
Shi, Yu [1 ]
Yu, Ning [1 ]
Sun, Yawei [1 ]
Liu, Jianyi [2 ]
机构
[1] Key Laboratory of Trustworthy Distributed Computing and Service, Ministry of Education, Beijing University of Posts and Telecommunications, Beijing,100876, China
[2] School of Cyberspace Security, Beijing University of Posts and Telecommunications, Beijing,100876, China
关键词
Adversarial machine learning - Contrastive Learning - Learning systems - Multi-task learning;
D O I
10.13190/j.jbupt.2023-270
中图分类号
学科分类号
摘要
To address the issue of the vast amount of memory usage associated with fine-tuning large language models in existing rumor detection methods, and to tackle the sensitivity of prompt learning to its initial point, a meta multi-task prompt learning method for zero-shot rumor detection is proposed. First, the objective of the zero-shot rumor detection task objective is modified based on the prompt learning, and the prompt template is designed to make its task objective align with the training task objective of large language models, fully leveraging the prior knowledge accumulated by large language models. Second, the parameter update strategy based on meta-learning is employed to rapidly identify suitable initial points of the prompt template for zero-shot rumor detection, and the meta-knowledge is learned from different meta-tasks to achieve parameter optimization. Finally, sentiment analysis is introduced as an auxiliary meta-task to further model parameter optimization. Extensive experiments conducted on real-world datasets demonstrate that the proposed model outperforms baseline methods in zero-shot rumor detection tasks, achieving the best performance across various metrics. © 2024 Beijing University of Posts and Telecommunications. All rights reserved.
引用
收藏
页码:77 / 82
相关论文
共 50 条
  • [1] Zero-Shot Rumor Detection with Propagation Structure via Prompt Learning
    Lin, Hongzhan
    Yi, Pengyao
    Ma, Jing
    Jiang, Haiyun
    Luo, Ziyang
    Shi, Shuming
    Liu, Ruifang
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 4, 2023, : 5213 - 5221
  • [2] Zero-Shot Task Generalization with Multi-Task Deep Reinforcement Learning
    Oh, Junhyuk
    Singh, Satinder
    Lee, Honglak
    Kohli, Pushmeet
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 70, 2017, 70
  • [3] Zero-Shot Rationalization by Multi-Task Transfer Learning from Question Answering
    Kung, Po-Nien
    Yang, Tse-Hsuan
    Chen, Yi-Cheng
    Yin, Sheng-Siang
    Chen, Yun-Nung
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, EMNLP 2020, 2020, : 2187 - 2197
  • [4] Generalized Zero-Shot Image Classification via Partially-Shared Multi-Task Representation Learning
    Wang, Gerui
    Tang, Sheng
    ELECTRONICS, 2023, 12 (09)
  • [5] Zero-shot object rumor detection based on contrastive learning
    Chen, Ke
    Zhang, Wenhao
    Zhejiang Daxue Xuebao (Gongxue Ban)/Journal of Zhejiang University (Engineering Science), 2024, 58 (09): : 1790 - 1800
  • [6] Joint Embedding with Multi-Task Learning for Multi-Label Zero-Shot Action Recognition
    An, Rongqiao
    Miao, Zhenjiang
    Li, Qingyu
    PROCEEDINGS OF 2018 14TH IEEE INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING (ICSP), 2018, : 613 - 618
  • [7] Zero-Shot Code Representation Learning via Prompt Tuning
    Cui, Nan
    Gu, Xiaodong
    Shen, Beijun
    arXiv,
  • [8] Generating Variable Explanations via Zero-shot Prompt Learning
    Wang, Chong
    Lou, Yiling
    Liu, Junwei
    Peng, Xin
    2023 38TH IEEE/ACM INTERNATIONAL CONFERENCE ON AUTOMATED SOFTWARE ENGINEERING, ASE, 2023, : 748 - 760
  • [9] Enhancing Zero-Shot Stance Detection with Contrastive and Prompt Learning
    Yao, Zhenyin
    Yang, Wenzhong
    Wei, Fuyuan
    ENTROPY, 2024, 26 (04)
  • [10] Better Learning Shot Boundary Detection via Multi-task
    Zhang, Haoxin
    Li, Zhimin
    Lu, Qinglin
    PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 4730 - 4734