ProZe: Explainable and Prompt-Guided Zero-Shot Text Classification

被引:1
|
作者
Harrando, Ismail [1 ]
Reboud, Alison [1 ]
Schleider, Thomas [1 ]
Ehrhart, Thibault [1 ]
Troncy, Raphael [1 ]
机构
[1] EURECOM Sophia Antipolis, F-06410 Biot, France
关键词
Task analysis; Predictive models; Internet; Computational modeling; Semantics; Adaptation models; Transformers; Text classification; Knowledge graphs; zero-shot; explainability; common sense knowledge graph; prompting language models;
D O I
10.1109/MIC.2022.3187080
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
As technology accelerates the generation and communication of textual data, the need to automatically understand this content becomes a necessity. In order to classify text, being it for tagging, indexing, or curating documents, one often relies on large, opaque models that are trained on preannotated datasets, making the process unexplainable, difficult to scale, and ill-adapted for niche domains with scarce data. To tackle these challenges, we propose ProZe, a text classification approach that leverages knowledge from two sources: prompting pretrained language models, as well as querying ConceptNet, a common-sense knowledge base which can be used to add a layer of explainability to the results. We evaluate our approach empirically and we show how this combination not only performs on par with state-of-the-art zero shot classification on several domains, but also offers explainable predictions that can be visualized.
引用
收藏
页码:69 / 77
页数:9
相关论文
共 50 条
  • [1] Prompt-Guided Zero-Shot Anomaly Action Recognition using Pretrained Deep Skeleton Features
    Sato, Fumiaki
    Hachiuma, Ryo
    Sekii, Taiki
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, : 6471 - 6480
  • [2] Prompt-based Zero-shot Text Classification with Conceptual Knowledge
    Wang, Yuqi
    Wang, Wei
    Chen, Qi
    Huang, Kaizhu
    Nguyen, Anh
    De, Suparna
    PROCEEDINGS OF THE 61ST ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, ACL-SRW 2023, VOL 4, 2023, : 30 - 38
  • [3] Zero-Shot Turkish Text Classification
    Birim, Ahmet
    Erden, Mustafa
    Arslan, Levent M.
    29TH IEEE CONFERENCE ON SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS (SIU 2021), 2021,
  • [4] ENHANCING CLASS UNDERSTANDING VIA PROMPT-TUNING FOR ZERO-SHOT TEXT CLASSIFICATION
    Dan, Yuhao
    Zhou, Jie
    Chen, Qin
    Bai, Qingchun
    He, Liang
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 4303 - 4307
  • [5] Knowledge-embedded Prompt Learning for Zero-shot Social Media Text Classification
    Li, Jingyi
    Chen, Qi
    Wang, Wei
    Wu, Fangyu
    2023 IEEE INTERNATIONAL CONFERENCE ON SMART COMPUTING, SMARTCOMP, 2023, : 222 - 224
  • [6] PESCO: Prompt-enhanced Self Contrastive Learning for Zero-shot Text Classification
    Wang, Yau-Shian
    Chi, Ta-Chung
    Zhang, Ruohong
    Yang, Yiming
    PROCEEDINGS OF THE 61ST ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2023): LONG PAPERS, VOL 1, 2023, : 14897 - 14911
  • [7] Retrieval Augmented Zero-Shot Text Classification
    Abdullahi, Tassallah
    Singh, Ritambhara
    Eickhoff, Carsten
    PROCEEDINGS OF THE 2024 ACM SIGIR INTERNATIONAL CONFERENCE ON THE THEORY OF INFORMATION RETRIEVAL, ICTIR 2024, 2024, : 195 - 203
  • [8] Prompt-based learning framework for zero-shot cross-lingual text classification
    Feng, Kai
    Huang, Lan
    Wang, Kangping
    Wei, Wei
    Zhang, Rui
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2024, 133
  • [9] Towards Visual Explainable Active Learning for Zero-Shot Classification
    Jia, Shichao
    Li, Zeyu
    Chen, Nuo
    Zhang, Jiawan
    IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2022, 28 (01) : 791 - 801
  • [10] Explainable Zero-Shot Modelling of Clinical Depression Symptoms from Text
    Farruque, Nawshad
    Goebel, Randy
    Zaiane, Osmar R.
    Sivapalan, Sudhakar
    20TH IEEE INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS (ICMLA 2021), 2021, : 1472 - 1477