Variable-Depth Convolutional Neural Network for Text Classification

被引:6
作者
Ch, Ka-Hou [1 ]
Im, Sio-Kei [1 ]
Ke, Wei [1 ]
机构
[1] Macao Polytech Inst, Sch Appl Sci, Macau, Peoples R China
来源
NEURAL INFORMATION PROCESSING, ICONIP 2020, PT V | 2021年 / 1333卷
关键词
Recurrent; Convolutional neural network; Text classification; Machine learning;
D O I
10.1007/978-3-030-63823-8_78
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This article introduces a recurrent CNN based framework for the classification of arbitrary length text in natural sentence. In our model, we present a complete CNN design with recurrent structure to capture the contextual information as far as possible when learning sentences, which allows arbitrary-length sentences and more flexibility to analyze complete sentences compared with traditional CNN based neural networks. In addition, our model greatly reduces the number of layers in the architecture and requires fewer training parameters, which leads to less memory consumption, and it can reach O (log n) time complexity. As a result, this model can achieve enhancement in training accuracy. Moreover, the design and implementation can be easily deployed in the current text classification systems.
引用
收藏
页码:685 / 692
页数:8
相关论文
共 27 条
[1]   Representation Learning: A Review and New Perspectives [J].
Bengio, Yoshua ;
Courville, Aaron ;
Vincent, Pascal .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2013, 35 (08) :1798-1828
[2]  
Boski M, 2017, 2017 10TH INTERNATIONAL WORKSHOP ON MULTIDIMENSIONAL (ND) SYSTEMS (NDS)
[3]  
Collobert R, 2011, J MACH LEARN RES, V12, P2493
[4]  
Conneau A, 2017, 15TH CONFERENCE OF THE EUROPEAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (EACL 2017), VOL 1: LONG PAPERS, P1107
[5]   FINDING STRUCTURE IN TIME [J].
ELMAN, JL .
COGNITIVE SCIENCE, 1990, 14 (02) :179-211
[6]  
Georgakopoulos S.V., SETN, P1
[7]  
Guggilla C., 2016, P COLING 2016 26 INT, P2740
[8]  
Hochreiter S, 1997, NEURAL COMPUT, V9, P1735, DOI [10.1162/neco.1997.9.8.1735, 10.1162/neco.1997.9.1.1, 10.1007/978-3-642-24797-2]
[9]   Deep Sentiment Representation Based on CNN and LSTM [J].
Huang, Qiongxia ;
Zheng, Xianghan ;
Chen, Riqing ;
Dong, Zhenxin .
2017 INTERNATIONAL CONFERENCE ON GREEN INFORMATICS (ICGI), 2017, :30-33
[10]   A Convolutional Neural Network for Modelling Sentences [J].
Kalchbrenner, Nal ;
Grefenstette, Edward ;
Blunsom, Phil .
PROCEEDINGS OF THE 52ND ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, VOL 1, 2014, :655-665