Chinese News Text Classification Method Based On Attention Mechanism

被引:3
|
作者
Ruan, Jinjun [1 ]
Caballero, Jonathan M. [1 ]
Juanatas, Ronaldo A. [1 ]
机构
[1] Technol Univ Philippines, Manila, Philippines
来源
2022 7TH INTERNATIONAL CONFERENCE ON BUSINESS AND INDUSTRIAL RESEARCH (ICBIR2022) | 2022年
关键词
Text Classification; Attention Mechanism; CNN; BiLSTM; Word2vec;
D O I
10.1109/ICBIR54589.2022.9786458
中图分类号
F [经济];
学科分类号
02 ;
摘要
Combining the convolution neural network (CNN) model and bidirectional long short-term memory (BiLSTM) model, an ATT-CN-BILSTM Chinese news classification model is proposed based on the attention mechanism. The model uses the attention mechanism to improve the feature extraction process of CNN and BiLSTM. After cancelling the CNN pooling layer, it pays attention to the critical local features obtained by CNN convolution according to the timing features output by BiLSTM, giving full play to the respective advantages of CNN and BiLSTM models. The experimental results on Thucnews dataset show that the accuracy of the model for Chinese news text classification is 97.87%, and the recall rate and F1 score are better than the comparison model.
引用
收藏
页码:330 / 334
页数:5
相关论文
共 50 条
  • [31] Self-Interaction Attention Mechanism Based Text Representation for Document Classification
    Zheng, Jianming
    Cai, Fei
    Shao, Taihua
    Chen, Honghui
    APPLIED SCIENCES-BASEL, 2018, 8 (04):
  • [32] ASPECT-BASED TEXT CLASSIFICATION FOR SENTIMENTAL ANALYSIS USING ATTENTION MECHANISM WITH RU-BILSTM
    Yelisetti, Sandeep
    Geethanjali, Nellore
    SCALABLE COMPUTING-PRACTICE AND EXPERIENCE, 2023, 24 (03): : 299 - 314
  • [33] SHORT-TEXT QUESTION CLASSIFICATION BASED ON DEPENDENCY PARSING AND ATTENTION MECHANISM
    Fang, An
    PROCEEDINGS OF 2019 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS (ICMLC), 2019, : 498 - 503
  • [34] News Text Classification Based on an Improved Convolutional Neural Network
    Tao, Wenjing
    Chang, Dan
    TEHNICKI VJESNIK-TECHNICAL GAZETTE, 2019, 26 (05): : 1400 - 1409
  • [35] The Automatic Text Classification Method Based on BERT and Feature Union
    Li, Wenting
    Gao, Shangbing
    Zhou, Hong
    Huang, Zihe
    Zhang, Kewen
    Li, Wei
    2019 IEEE 25TH INTERNATIONAL CONFERENCE ON PARALLEL AND DISTRIBUTED SYSTEMS (ICPADS), 2019, : 774 - 777
  • [36] Multi-model Fusion Attention Network for News Text Classification
    Li Z.
    Wu J.
    Miao J.
    Yu X.
    Li S.
    International Journal for Engineering Modelling, 2022, 35 (02) : 1 - 15
  • [37] A Trusted Classification Method of Encrypted Traffic Based on Attention Mechanism
    Miao, Cheng
    Wang, Pan
    Wang, ZiXuan
    Li, ZeYi
    2022 IEEE INTL CONF ON DEPENDABLE, AUTONOMIC AND SECURE COMPUTING, INTL CONF ON PERVASIVE INTELLIGENCE AND COMPUTING, INTL CONF ON CLOUD AND BIG DATA COMPUTING, INTL CONF ON CYBER SCIENCE AND TECHNOLOGY CONGRESS (DASC/PICOM/CBDCOM/CYBERSCITECH), 2022, : 473 - 480
  • [38] Polarimetric Imaging Target Classification Method Based on Attention Mechanism
    Sun Rui
    Sun Xiaobing
    Liu Xiao
    Song Qiang
    ACTA OPTICA SINICA, 2021, 41 (16)
  • [39] Two-channel hierarchical attention mechanism model for short text classification
    Guanghui Chang
    Shiyang Hu
    Haihui Huang
    The Journal of Supercomputing, 2023, 79 : 6991 - 7013
  • [40] Word-character attention model for Chinese text classification
    Qiao, Xue
    Peng, Chen
    Liu, Zhen
    Hu, Yanfeng
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2019, 10 (12) : 3521 - 3537