Recurrent Neural Network to Deep Learn Conversation in Indonesian

被引:5
作者
Chowanda, Andry [1 ]
Chowanda, Alan Darmasaputra [1 ,2 ]
机构
[1] Bina Nusantara Univ, Comp Sci Dept, Sch Comp Sci, Jl KH Syahdan 9, Jakarta 11480, Indonesia
[2] GDP Labs, Jl Aipda KS Tubun 2 C 8, Jakarta 11410, Indonesia
来源
DISCOVERY AND INNOVATION OF COMPUTER SCIENCE TECHNOLOGY IN ARTIFICIAL INTELLIGENCE ERA | 2017年 / 116卷
关键词
LTSM; Conversation; Indonesian; Word2Vec; Deep Learning;
D O I
10.1016/j.procs.2017.10.078
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Natural Language Processing (NLP) is still considered a daunting task to solve for us, researcher in this field. Specifically, there is not many research has been done in a local language like Indonesian Language. Nowdays, there are hundreds of systems that require NLP as their main functions. This could be a good opportunity for us to explore this opportunity. This paper contributes models from deep learning training in Indonesian conversation using dual encoder LSTM as well as vector representation models trained with three corpora using Skip-gram method. The results show that the models are able to make a good correlation, synonym from a particular word in the words representation of vector models. In addition, the conversation models resulted in 1.07 of perplexity in the Combined model in the 14000th steps. (c) 2017 The Authors. Published by Elsevier B.V.
引用
收藏
页码:579 / 586
页数:8
相关论文
共 17 条
[1]  
[Anonymous], 2014, Advances in neural information processing systems
[2]  
[Anonymous], 2015, SIGDIAL C
[3]  
[Anonymous], 2011, ACL
[4]  
[Anonymous], ARXIV13013781
[5]  
Cassell J, 2000, EMBODIED CONVERSATIONAL AGENTS, P29
[6]  
Chowanda A, 2016, AAMAS'16: PROCEEDINGS OF THE 2016 INTERNATIONAL CONFERENCE ON AUTONOMOUS AGENTS & MULTIAGENT SYSTEMS, P1343
[7]   Playing with Social and Emotional Game Companions [J].
Chowanda, Andry ;
Flintham, Martin ;
Blanchfield, Peter ;
Valstar, Michel .
INTELLIGENT VIRTUAL AGENTS, IVA 2016, 2016, 10011 :85-95
[8]  
Chowanda A, 2014, LECT NOTES ARTIF INT, V8637, P134, DOI 10.1007/978-3-319-09767-1_16
[9]   Deep Neural Networks for Acoustic Modeling in Speech Recognition [J].
Hinton, Geoffrey ;
Deng, Li ;
Yu, Dong ;
Dahl, George E. ;
Mohamed, Abdel-rahman ;
Jaitly, Navdeep ;
Senior, Andrew ;
Vanhoucke, Vincent ;
Patrick Nguyen ;
Sainath, Tara N. ;
Kingsbury, Brian .
IEEE SIGNAL PROCESSING MAGAZINE, 2012, 29 (06) :82-97
[10]  
Koto F., 2016, LREC