Target-Phrase Zero-Shot Stance Detection: Where Do We Stand?

被引:0
作者
Motyka, Dawid [1 ]
Piasecki, Maciej [1 ]
机构
[1] Wroclaw Univ Sci & Technol, Dept Artificial Intelligence, Wroclaw, Poland
来源
COMPUTATIONAL SCIENCE, ICCS 2024, PT II | 2024年 / 14833卷
关键词
stance detection; zero-shot learning; prompt based learning for transformers;
D O I
10.1007/978-3-031-63751-3_3
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Stance detection, i.e. recognition of utterances in favor, against or neutral in relation to some targets is important for text analysis. However, different approaches were tested on different datasets, often interpreted in different ways. We propose a unified overview of the state-of-the-art stance detection methods in which targets are expressed by short phrases. Special attention is given to zero-shot learning settings. An overview of the available multiple target datasets is presented that reveals several problems with the sets and their proper interpretation. Wherever possible, methods were re-run or even re-implemented to facilitate reliable comparison. A novel modification of a prompt-based approach to training encoder transformers for stance detection is proposed. It showed comparable results to those obtained with large language models, but at the cost of an order of magnitude fewer parameters. Our work tries to reliably show where do we stand in stance detection and where should we go, especially in terms of datasets and experimental settings.
引用
收藏
页码:34 / 49
页数:16
相关论文
共 36 条
  • [11] Glandt K, 2021, 59TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS AND THE 11TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING, VOL 1 (ACL-IJCNLP 2021), P1596
  • [12] Hardalov M, 2021, 2021 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2021), P9011
  • [13] He ZH, 2022, PROCEEDINGS OF THE 12TH WORKSHOP ON COMPUTATIONAL APPROACHES TO SUBJECTIVITY, SENTIMENT & SOCIAL MEDIA ANALYSIS, P71
  • [14] Zero-shot stance detection via multi-perspective contrastive with unlabeled data
    Jiang, Yan
    Gao, Jinhua
    Shen, Huawei
    Cheng, Xueqi
    [J]. INFORMATION PROCESSING & MANAGEMENT, 2023, 60 (04)
  • [15] ChatGPT: Jack of all trades, master of none
    Kocon, Jan
    Cichecki, Igor
    Kaszyca, Oliwier
    Kochanek, Mateusz
    Szydlo, Dominika
    Baran, Joanna
    Bielaniewicz, Julita
    Gruza, Marcin
    Janz, Arkadiusz
    Kanclerz, Kamil
    Kocon, Anna
    Koptyra, Bartlomiej
    Mieleszczenko-Kowszewicz, Wiktoria
    Milkowski, Piotr
    Oleksy, Marcin
    Piasecki, Maciej
    Radlinski, Lukasz
    Wojtasik, Konrad
    Wozniak, Stanislaw
    Kazienko, Przemyslaw
    [J]. INFORMATION FUSION, 2023, 99
  • [16] Lewis M., 2019, P 58 ANN M ASS COMP
  • [17] Li Yingjie, 2023, WWW '23: Proceedings of the ACM Web Conference 2023, P1500, DOI 10.1145/3543507.3583250
  • [18] Li YJ, 2021, FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, ACL-IJCNLP 2021, P2355
  • [19] Liang B, 2022, PROCEEDINGS OF THE 60TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2022), VOL 1: (LONG PAPERS), P81
  • [20] Zero-Shot Stance Detection via Contrastive Learning
    Liang, Bin
    Chen, Zixiao
    Gui, Lin
    He, Yulan
    Yang, Min
    Xu, Ruifeng
    [J]. PROCEEDINGS OF THE ACM WEB CONFERENCE 2022 (WWW'22), 2022, : 2738 - 2747