Enhancing Text Classification by Graph Neural Networks With Multi-Granular Topic-Aware Graph

被引:18
作者
Gu, Yongchun [1 ]
Wang, Yi [2 ]
Zhang, Heng-Ru [3 ]
Wu, Jiao [4 ]
Gu, Xingquan [5 ]
机构
[1] Sichuan Univ Arts & Sci, Sch Math, Dazhou 635000, Peoples R China
[2] Zhejiang Normal Univ, Key Lab Intelligent Educ Technol & Applicat Zhejia, Jinhua 321004, Peoples R China
[3] Southwest Petr Univ, Sch Comp Sci, Chengdu 610500, Peoples R China
[4] China Jiliang Univ, Coll Sci, Hangzhou 310018, Peoples R China
[5] China Jiliang Univ, Coll Standardizat, Hangzhou 310018, Peoples R China
关键词
Text categorization; Graph neural networks; Feature extraction; Representation learning; Neural networks; Task analysis; Support vector machines; text classification; text graph construction;
D O I
10.1109/ACCESS.2023.3250109
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Text classification based on graph neural networks (GNNs) has been widely studied by virtue of its potential to capture complex and across-granularity relations among texts of different types from learning on a text graph. Existing methods typically construct text graphs based on words-documents to capture relevant intra-class document representations among the same documents via words-words and words-documents propagation. However, a natural problem is that polysemy words in documents may become an information medium between documents of different categories, promoting heterophily information propagation. The performance of text classification will be somewhat constrained by this issue. This paper proposes a novel text classification method based on GNN from multi-granular topic-aware perspective, referred to as Text-MGNN. Specifically, topic nodes are introduced to build a triple node set of "word, document, topic, " and multi-granularity relations are modeled on a text graph for this triple node set. The introduction of topic nodes has three significant advantages. The first is to strengthen the propagation of topics, words, and documents. The second is to enhance class-aware representation learning. The final is to mitigate the effect of heterophily information caused by polysemy words. Extensive experiments are conducted on three real-world datasets. Results validate that our proposed method outperforms 11 baselines methods.
引用
收藏
页码:20169 / 20183
页数:15
相关论文
共 45 条
[1]  
Amin Irtiqa, 2021, Proceedings of 2021 2nd International Conference on Intelligent Engineering and Management (ICIEM), P91, DOI 10.1109/ICIEM51511.2021.9445280
[2]   A comprehensive survey on sentiment analysis: Approaches, challenges and trends [J].
Birjali, Marouane ;
Kasri, Mohammed ;
Beni-Hssane, Abderrahim .
KNOWLEDGE-BASED SYSTEMS, 2021, 226
[3]  
Birunda S. Selva, 2021, Innovative Data Communication Technologies and Application. Proceedings of ICIDCA 2020. Lecture Notes on Data Engineering and Communications Technologies (LNDECT 59), P267, DOI 10.1007/978-981-15-9651-3_23
[4]  
CHURCH KW, 1990, 27TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, P76
[5]  
Defferrard M, 2016, ADV NEUR IN, V29
[6]   Text categorization: past and present [J].
Dhar, Ankita ;
Mukherjee, Himadri ;
Dash, Niladri Sekhar ;
Roy, Kaushik .
ARTIFICIAL INTELLIGENCE REVIEW, 2021, 54 (04) :3007-3054
[7]   A new similarity measure for vector space models in text classification and information retrieval [J].
Eminagaoglu, Mete .
JOURNAL OF INFORMATION SCIENCE, 2022, 48 (04) :463-476
[8]   Multimodal sentiment analysis: A systematic review of history, datasets, multimodal fusion methods, applications, challenges and future directions [J].
Gandhi, Ankita ;
Adhvaryu, Kinjal ;
Poria, Soujanya ;
Cambria, Erik ;
Hussain, Amir .
INFORMATION FUSION, 2023, 91 :424-444
[9]   Application of improved distributed naive Bayesian algorithms in text classification [J].
Gao, Hongyi ;
Zeng, Xi ;
Yao, Chunhua .
JOURNAL OF SUPERCOMPUTING, 2019, 75 (09) :5831-5847
[10]  
Golik P, 2013, INTERSPEECH, P1755