Target-Phrase Zero-Shot Stance Detection: Where Do We Stand?

被引:0
作者
Motyka, Dawid [1 ]
Piasecki, Maciej [1 ]
机构
[1] Wroclaw Univ Sci & Technol, Dept Artificial Intelligence, Wroclaw, Poland
来源
COMPUTATIONAL SCIENCE, ICCS 2024, PT II | 2024年 / 14833卷
关键词
stance detection; zero-shot learning; prompt based learning for transformers;
D O I
10.1007/978-3-031-63751-3_3
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Stance detection, i.e. recognition of utterances in favor, against or neutral in relation to some targets is important for text analysis. However, different approaches were tested on different datasets, often interpreted in different ways. We propose a unified overview of the state-of-the-art stance detection methods in which targets are expressed by short phrases. Special attention is given to zero-shot learning settings. An overview of the available multiple target datasets is presented that reveals several problems with the sets and their proper interpretation. Wherever possible, methods were re-run or even re-implemented to facilitate reliable comparison. A novel modification of a prompt-based approach to training encoder transformers for stance detection is proposed. It showed comparable results to those obtained with large language models, but at the cost of an order of magnitude fewer parameters. Our work tries to reliably show where do we stand in stance detection and where should we go, especially in terms of datasets and experimental settings.
引用
收藏
页码:34 / 49
页数:16
相关论文
共 36 条
  • [1] Addawood A., 2017, PROC 8 INT C SOC MED, P1
  • [2] Zero-shot stance detection: Paradigms and challenges
    Allaway, Emily
    McKeown, Kathleen
    [J]. FRONTIERS IN ARTIFICIAL INTELLIGENCE, 2023, 5
  • [3] Allaway E, 2021, 2021 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES (NAACL-HLT 2021), P4756
  • [4] Allaway E, 2020, PROCEEDINGS OF THE 2020 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP), P8913
  • [5] Barbieri F, 2020, FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, EMNLP 2020, P1644
  • [6] Brown TB, 2020, ADV NEUR IN, V33
  • [7] Derczynski Leon, 2017, P 11 INT WORKSH SEM, P69, DOI 10.18653/v1/S17-2006
  • [8] Devlin J, 2019, 2019 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES (NAACL HLT 2019), VOL. 1, P4171
  • [9] Fan LS, 2019, 2019 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING AND THE 9TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING (EMNLP-IJCNLP 2019), P6343
  • [10] Gao TY, 2021, 59TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS AND THE 11TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING (ACL-IJCNLP 2021), VOL 1, P3816