Chain of Stance: Stance Detection with Large Language Models

被引:0
作者
Ma, Junxia [1 ]
Wang, Changjiang [1 ]
Xing, Hanwen [2 ]
Zhao, Dongming [3 ]
Zhang, Yazhou [4 ]
机构
[1] Zhengzhou Univ Light Ind, Coll Software Engn, Zhengzhou, Peoples R China
[2] UCL, London, England
[3] China Mobile Commun Grp Tianjin Co Ltd, Artificial Intelligence Lab, Tianjin, Peoples R China
[4] Tianjin Univ, Tianjin, Peoples R China
来源
NATURAL LANGUAGE PROCESSING AND CHINESE COMPUTING, PT V, NLPCC 2024 | 2025年 / 15363卷
基金
中国博士后科学基金;
关键词
stance detection; CoS; LLM;
D O I
10.1007/978-981-97-9443-0_7
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Stance detection is an active task in natural language processing (NLP) that aims to identify the author's stance towards a particular target within a text. Given the remarkable language understanding capabilities and encyclopedic prior knowledge of large language models (LLMs), how to explore the potential of LLMs in stance detection has received significant attention. Unlike existing LLM-based approaches that focus solely on fine-tuning with large-scale datasets, we propose a new prompting method, called Chain of Stance (CoS). In particular, it positions LLMs as expert stance detectors by decomposing the stance detection process into a series of intermediate, stance-related assertions that culminate in the final judgment. This approach leads to significant improvements in classification performance. We conducted extensive experiments using four SOTA LLMs on the SemEval 2016 dataset, covering the zero-shot and few-shot learning setups. The results indicate that the proposed method achieves state-of-the-art results with an F1 score of 79.84 in the few-shot setting.
引用
收藏
页码:82 / 94
页数:13
相关论文
共 21 条
[1]  
Bai JZ, 2023, Arxiv, DOI [arXiv:2309.16609, 10.48550/arXiv.2309.16609, DOI 10.48550/ARXIV.2309.16609]
[2]  
Cheng YH, 2024, Arxiv, DOI arXiv:2404.17609
[3]   Leveraging Chain-of-Thought to Enhance Stance Detection with Prompt-Tuning [J].
Ding, Daijun ;
Fu, Xianghua ;
Peng, Xiaojiang ;
Fan, Xiaomao ;
Huang, Hu ;
Zhang, Bowen .
MATHEMATICS, 2024, 12 (04)
[4]  
Hanley HWA, 2024, Arxiv, DOI arXiv:2310.14450
[5]  
Hardalov M, 2022, AAAI CONF ARTIF INTE, P10729
[6]  
Hardalov M, 2022, Arxiv, DOI arXiv:2103.00242
[7]   Knowledge-enhanced Prompt-tuning for Stance Detection [J].
Huang, Hu ;
Zhang, Bowen ;
Li, Yangyang ;
Zhang, Baoquan ;
Sun, Yuxi ;
Luo, Chuyao ;
Peng, Cheng .
ACM TRANSACTIONS ON ASIAN AND LOW-RESOURCE LANGUAGE INFORMATION PROCESSING, 2023, 22 (06)
[8]  
Lan XC, 2024, Arxiv, DOI [arXiv:2310.10467, 10.48550/arXiv.2310.10467]
[9]  
Lebret Gul, 2024, Stance detection on social media with fine-tuned large language models
[10]  
Li A, 2023, 2023 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2023), P15703