A Local Explainability Technique for Graph Neural Topic Models

被引:0
作者
Bharathwajan Rajendran
Chandran G. Vidya
J. Sanil
S. Asharaf
机构
[1] Kerala University of Digital Sciences,School of Computer Science and Engineering
[2] Innovation and Technology,undefined
来源
Human-Centric Intelligent Systems | 2024年 / 4卷 / 1期
关键词
Explainable neural network; Graph neural topic model; Local explainable; Natural language processing; Topic modelling;
D O I
10.1007/s44230-023-00058-8
中图分类号
学科分类号
摘要
Topic modelling is a Natural Language Processing (NLP) technique that has gained popularity in the recent past. It identifies word co-occurrence patterns inside a document corpus to reveal hidden topics. Graph Neural Topic Model (GNTM) is a topic modelling technique that uses Graph Neural Networks (GNNs) to learn document representations effectively. It provides high-precision documents-topics and topics-words probability distributions. Such models find immense application in many sectors, including healthcare, financial services, and safety-critical systems like autonomous cars. This model is not explainable. As a matter of fact, the user cannot comprehend the underlying decision-making process. The paper introduces a technique to explain the documents-topics probability distributions output of GNTM. The explanation is achieved by building a local explainable model such as a probabilistic Naïve Bayes classifier. The experimental results using various benchmark NLP datasets show a fidelity of 88.39% between the predictions of GNTM and the local explainable model. This similarity implies that the proposed technique can effectively explain the documents-topics probability distribution output of GNTM.
引用
收藏
页码:53 / 76
页数:23
相关论文
共 122 条
[1]  
Abdelrazek A(2023)Topic modeling algorithms and applications: a survey Inform Syst 112 1-35
[2]  
Eid Y(2022)The evolution of topic modeling ACM Comput Surv 54 16-199
[3]  
Gawish E(2022)Topic modeling revisited: new evidence on algorithm performance and quality metrics PLoS ONE 7 189-283
[4]  
Medhat W(2019)Topic modeling: a comprehensive review EAI Endors Trans Scalable Inf Syst 15 273-35
[5]  
Hassan A(2021)A distributional semantics-based information retrieval framework for online social networks Intell Decis Technol 10 1-15211
[6]  
Churchill R(2016)Matrix-like visualization based on topic modeling for discovering connections between disjoint disciplines Intell Decis Technol 54 15169-1022
[7]  
Singh L(2019)Smart literature review: a practical topic modelling approach to exploratory literature review J Big Data 78 993-233
[8]  
Rüdiger M(2021)Topic modeling in software engineering research Empir Softw Eng 3 102470-13617
[9]  
Antons D(2022)A topic modeling comparison between LDA, NMF, Top2Vec, and BERTopic to demystify twitter posts Front Sociol. 79 1424-24
[10]  
Joshi AM(2021)Research on multi-label text classification method based on tALBERT-CNN Int J Comput Intell Syst 11 183-5799