A Framework for Text Classification Using Evolutionary Contiguous Convolutional Neural Network and Swarm Based Deep Neural Network

被引:2
作者
Prabhakar, Sunil Kumar [1 ]
Rajaguru, Harikumar [2 ]
So, Kwangsub [1 ]
Won, Dong-Ok [1 ]
机构
[1] Hallym Univ, Dept Artificial Intelligence Convergence, Chunchon, South Korea
[2] Bannari Amman Inst Technol, Dept ECE, Sathyamangalam, India
关键词
natural language processing; Differential Evolution; Particle Swarm Optimization; Convolutional Neural Network; deep neural network; DIFFERENTIAL EVOLUTION; FEATURE-SELECTION; DECISION TREES; OPTIMIZATION; ATTENTION; CLASSIFIERS; ALGORITHM; MODEL;
D O I
10.3389/fncom.2022.900885
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
To classify the texts accurately, many machine learning techniques have been utilized in the field of Natural Language Processing (NLP). For many pattern classification applications, great success has been obtained when implemented with deep learning models rather than using ordinary machine learning techniques. Understanding the complex models and their respective relationships within the data determines the success of such deep learning techniques. But analyzing the suitable deep learning methods, techniques, and architectures for text classification is a huge challenge for researchers. In this work, a Contiguous Convolutional Neural Network (CCNN) based on Differential Evolution (DE) is initially proposed and named as Evolutionary Contiguous Convolutional Neural Network (ECCNN) where the data instances of the input point are considered along with the contiguous data points in the dataset so that a deeper understanding is provided for the classification of the respective input, thereby boosting the performance of the deep learning model. Secondly, a swarm-based Deep Neural Network (DNN) utilizing Particle Swarm Optimization (PSO) with DNN is proposed for the classification of text, and it is named Swarm DNN. This model is validated on two datasets and the best results are obtained when implemented with the Swarm DNN model as it produced a high classification accuracy of 97.32% when tested on the BBC newsgroup text dataset and 87.99% when tested on 20 newsgroup text datasets. Similarly, when implemented with the ECCNN model, it produced a high classification accuracy of 97.11% when tested on the BBC newsgroup text dataset and 88.76% when tested on 20 newsgroup text datasets.
引用
收藏
页数:17
相关论文
共 74 条
[1]   Sentiment Analysis Using Common-Sense and Context Information [J].
Agarwal, Basant ;
Mittal, Namita ;
Bansal, Pooja ;
Garg, Sonal .
COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2015, 2015
[2]  
Aggarwal CharuC., 2012, MINING TEXT DATA, DOI DOI 10.1007/978-1-4614-3223-4.6
[3]   A Particle Swarm Optimization Based Deep Learning Model for Vehicle Classification [J].
Alhudhaif, Adi ;
Saeed, Ammar ;
Imran, Talha ;
Kamran, Muhammad ;
Alghamdi, Ahmed S. ;
Aseeri, Ahmed O. ;
Alsubai, Shtwai .
COMPUTER SYSTEMS SCIENCE AND ENGINEERING, 2022, 40 (01) :223-235
[4]   Semantic text classification: A survey of past and recent advances [J].
Altinel, Berna ;
Ganiz, Murat Can .
INFORMATION PROCESSING & MANAGEMENT, 2018, 54 (06) :1129-1153
[5]  
Amini M., 2009, Adv. Neural Inf. Process. Syst., P28
[6]  
[Anonymous], 2016, P COLING 2016 26 INT
[7]  
Aro T.O., 2020, ICT RES APPL, V2, P1
[8]   Feature Selection Empowered by Self-Inertia Weight Adaptive Particle Swarm Optimization for Text Classification [J].
Asif, Muhammad ;
Nagra, Arfan Ali ;
Bin Ahmad, Maaz ;
Masood, Khalid .
APPLIED ARTIFICIAL INTELLIGENCE, 2022, 36 (01)
[9]   A Robust Text Classifier Based on Denoising Deep Neural Network in the Analysis of Big Data [J].
Aziguli, Wulamu ;
Zhang, Yuanyu ;
Xie, Yonghong ;
Zhang, Dezheng ;
Luo, Xiong ;
Li, Chunmiao ;
Zhang, Yao .
SCIENTIFIC PROGRAMMING, 2017, 2017
[10]   Differential Evolution for Neural Networks Optimization [J].
Baioletti, Marco ;
Di Bari, Gabriele ;
Milani, Alfredo ;
Poggioni, Valentina .
MATHEMATICS, 2020, 8 (01)