A cross-language short text classification model based on BERT and multilayer collaborative convolutional neural network (MCNN)

被引:0
作者
Hu, Qiong [1 ]
机构
[1] Computer Science and Communications Department, Nanjing Tech University, Pujiang Institute, Jiangsu, Nanjing
来源
MCB Molecular and Cellular Biomechanics | 2024年 / 21卷 / 03期
关键词
BERT; classification model; cross-lingual short text; MCNN;
D O I
10.62617/mcb739
中图分类号
学科分类号
摘要
This study focuses on cross-lingual short text classification tasks and aims to combine the advantages of BERT and Multi-layer Collaborative Convolutional Neural Network (MCNN) to build an efficient classification model. BERT model provides rich semantic information for text classification with its powerful language understanding and bidirectional context modeling ability, while MCNN effectively extracts local and global features in text through multi-layer convolution structure and collaborative working mechanism. In this study, the output of BERT is used as the input of MCNN, and MCNN is used to further mine the deep features in the text, so as to realize the high-precision classification of cross-lingual short text. The experimental results show that the model has achieved significant performance improvement on the dataset, which provides a new effective solution for cross-lingual short text classification tasks. © 2024 by author(s).
引用
收藏
相关论文
共 25 条
[1]  
Luhn H P., The Automatic Creation of Literature Abstracts, Ibm Journal of Research and Development, 2, 2, pp. 159-165, (1958)
[2]  
Maron M E, Kuhns J L., On Relevance, Probabilistic Indexing and Information Retrieval, Journal of the ACM, 7, 3, pp. 216-244, (1960)
[3]  
Akhter M P, Zheng J, Naqvi I R, Et al., Document-Level Text Classification Using Single-Layer Multisize Filters Convolutional Neural Network, IEEE Access, 8, pp. 42689-42707, (2020)
[4]  
Deng J, Cheng L, Wang Z., Attention-based BiLSTM fused CNN with gating mechanism model for Chinese long text classification, Computer Speech And Language, 68, (2021)
[5]  
Jin Y, Zhu Q, Deng X., Weighted hierarchy mechanism over BERT for long text classifification, International Conference on Artificial Intelli- gence and Security, pp. 566-574, (2021)
[6]  
Szegedy C, Liu W, Jia YQ, Et al., Going deeper with convolutions, Proceedings of the IEEE Conference on Computer Vision and Pat-tern Recognition, pp. 1-9, (2015)
[7]  
Xu P, Luo Z X, Huang XK., Research on sentiment analysis of product reviews based on Bert BiLSTM, Intelligent Computer and Applications, 12, 11, pp. 186-191, (2022)
[8]  
Hao W, Jian W, Dongliang N, Et al., Transmission line fault cause identification method based on transient waveform image and MCNN-LSTM, Measurement, (2023)
[9]  
Nan Z, Lin-Shuang Z., Method for real-time prediction of cutter wear during shield tunnelling: A new wear rate index and MCNN-GRU, MethodsX, pp. 10102017-10102017, (2023)
[10]  
Wang A, Qi Y, Baiyila D., C-BERT: A Mongolian reverse dictionary based on fused lexical semantic clustering and BERT, Alexandria Engineering Journal, pp. 111385-111395, (2025)