Evolving Neural Networks for Text Classification using Genetic Algorithm-based Approaches

被引:8
作者
Andersen, Hayden [1 ]
Stevenson, Sean [1 ]
Ha, Tuan [1 ]
Gao, Xiaoying [1 ]
Xue, Bing [1 ]
机构
[1] Victoria Univ Wellington, Sch Engn & Comp Sci, Wellington, New Zealand
来源
2021 IEEE CONGRESS ON EVOLUTIONARY COMPUTATION (CEC 2021) | 2021年
关键词
Genetic Algorithm; Convolutional Neural Network; Text Classification;
D O I
10.1109/CEC45853.2021.9504920
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Convolutional Neural Networks (CNNs) have been well-known for their promising performance in text classification and sentiment analysis because they can preserve the 1D spatial orientation of a document, where the sequence of words is essential. However, designing the network architecture of CNNs is by no means an easy task, since it requires domain knowledge from both the deep CNN and text classification areas, which are often not available and can increase operating costs for anyone wishing to implement this method. Furthermore, such domain knowledge is often different in different text classification problems. To resolve these issues, this paper proposes the use of Genetic Algorithm to automatically search for the optimal network architecture without requiring any intervention from experts. The proposed approach is applied on the IMDB dataset, and the experimental results show that it achieves competitive performance with the current state-of-the-art and manually-designed approaches in terms of accuracy, and also it requires only a few hours of training time.
引用
收藏
页码:1241 / 1248
页数:8
相关论文
共 24 条
[1]   A survey on evolutionary machine learning [J].
Al-Sahaf, Harith ;
Bi, Ying ;
Chen, Qi ;
Lensen, Andrew ;
Mei, Yi ;
Sun, Yanan ;
Tran, Binh ;
Xue, Bing ;
Zhang, Mengjie .
JOURNAL OF THE ROYAL SOCIETY OF NEW ZEALAND, 2019, 49 (02) :205-228
[2]  
[Anonymous], 2015, N AM CHAPTER ASS COM, DOI DOI 10.3115/V1/N15-1011
[3]  
Bridle J. S., 1990, Neurocomputing, Algorithms, Architectures and Applications. Proceedings of the NATO Advanced Research Workshop, P227
[4]  
Dai AM, 2015, ADV NEUR IN, V28
[5]  
Deb Kalyanmoy, 1989, Complex Syst.
[6]   Large Scale Evolution of Convolutional Neural Networks Using Volunteer Computing [J].
Desell, Travis .
PROCEEDINGS OF THE 2017 GENETIC AND EVOLUTIONARY COMPUTATION CONFERENCE COMPANION (GECCO'17 COMPANION), 2017, :127-128
[7]  
Dufourq E, 2017, 2017 PATTERN RECOGNITION ASSOCIATION OF SOUTH AFRICA AND ROBOTICS AND MECHATRONICS (PRASA-ROBMECH), P110, DOI 10.1109/RoboMech.2017.8261132
[8]  
Hotho A., 2005, LDV FORUM, V20, P19, DOI [DOI 10.21248/JLCL.20.2005.68, 10.21248/jlcl.20.2005.68]
[9]  
King DB, 2015, ACS SYM SER, V1214, P1, DOI 10.1021/bk-2015-1214.ch001
[10]   Evolutionary Neural AutoML for Deep Learning [J].
Liang, Jason ;
Meyerson, Elliot ;
Hodjat, Babak ;
Fink, Dan ;
Mutch, Karl ;
Miikkulainen, Risto .
PROCEEDINGS OF THE 2019 GENETIC AND EVOLUTIONARY COMPUTATION CONFERENCE (GECCO'19), 2019, :401-409