Recurrent Neural Network to Deep Learn Conversation in Indonesian

被引:5
|
作者
Chowanda, Andry [1 ]
Chowanda, Alan Darmasaputra [1 ,2 ]
机构
[1] Bina Nusantara Univ, Comp Sci Dept, Sch Comp Sci, Jl KH Syahdan 9, Jakarta 11480, Indonesia
[2] GDP Labs, Jl Aipda KS Tubun 2 C 8, Jakarta 11410, Indonesia
关键词
LTSM; Conversation; Indonesian; Word2Vec; Deep Learning;
D O I
10.1016/j.procs.2017.10.078
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Natural Language Processing (NLP) is still considered a daunting task to solve for us, researcher in this field. Specifically, there is not many research has been done in a local language like Indonesian Language. Nowdays, there are hundreds of systems that require NLP as their main functions. This could be a good opportunity for us to explore this opportunity. This paper contributes models from deep learning training in Indonesian conversation using dual encoder LSTM as well as vector representation models trained with three corpora using Skip-gram method. The results show that the models are able to make a good correlation, synonym from a particular word in the words representation of vector models. In addition, the conversation models resulted in 1.07 of perplexity in the Combined model in the 14000th steps. (c) 2017 The Authors. Published by Elsevier B.V.
引用
收藏
页码:579 / 586
页数:8
相关论文
共 50 条
  • [21] Cryptocurrency malware hunting: A deep Recurrent Neural Network approach
    Yazdinejad, Abbas
    HaddadPajouh, Hamed
    Dehghantanha, Ali
    Parizi, Reza M.
    Srivastava, Gautam
    Chen, Mu-Yen
    APPLIED SOFT COMPUTING, 2020, 96
  • [22] Measuring System Entropy with a Deep Recurrent Neural Network Model
    Martinez-Garcia, Miguel
    Zhang, Yu
    Suzuki, Kenji
    Zhang, Yudong
    2019 IEEE 17TH INTERNATIONAL CONFERENCE ON INDUSTRIAL INFORMATICS (INDIN), 2019, : 1253 - 1256
  • [23] A Deep Recurrent Neural Network with BiLSTM model for Sentiment Classification
    Sharfuddin, Abdullah Aziz
    Tihami, Md. Nafis
    Islam, Md. Saiful
    2018 INTERNATIONAL CONFERENCE ON BANGLA SPEECH AND LANGUAGE PROCESSING (ICBSLP), 2018,
  • [24] Voltage Instability Prediction Using a Deep Recurrent Neural Network
    Hagmar, Hannes
    Tong, Lang
    Eriksson, Robert
    Tuan, Le Anh
    IEEE TRANSACTIONS ON POWER SYSTEMS, 2021, 36 (01) : 17 - 27
  • [25] CATEGORY DRIVEN DEEP RECURRENT NEURAL NETWORK FOR VIDEO SUMMARIZATION
    Song, Xinhui
    Chen, Ke
    Lei, Jie
    Sun, Li
    Wang, Zhiyuan
    Xie, Lei
    Song, Mingli
    2016 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA & EXPO WORKSHOPS (ICMEW), 2016,
  • [26] Aspect of Blame in Tweets: A Deep Recurrent Neural Network Approach
    Wandabwa, Herman
    Naeem, M. Asif
    Mirza, Farhaan
    WWW'17 COMPANION: PROCEEDINGS OF THE 26TH INTERNATIONAL CONFERENCE ON WORLD WIDE WEB, 2017, : 1423 - 1424
  • [27] Optimal deep recurrent neural network for sentiment grade classification
    Jasti, Sireesha
    INTERNATIONAL JOURNAL OF WEB INFORMATION SYSTEMS, 2021, 17 (06) : 557 - 579
  • [28] Deep Recurrent Neural Network for Multi-target Filtering
    Emambakhsh, Mehryar
    Bay, Alessandro
    Vazquez, Eduard
    MULTIMEDIA MODELING, MMM 2019, PT II, 2019, 11296 : 519 - 531
  • [29] A deep gated recurrent neural network for petroleum production forecasting
    Al-Shabandar, Raghad
    Jaddoa, Ali
    Liatsis, Panos
    Hussain, Abir Jaafar
    MACHINE LEARNING WITH APPLICATIONS, 2021, 3
  • [30] HypernasalityNet: Deep recurrent neural network for automatic hypernasality detection
    Wang, Xiyue
    Yang, Sen
    Tang, Ming
    Yin, Heng
    Huang, Hua
    He, Ling
    INTERNATIONAL JOURNAL OF MEDICAL INFORMATICS, 2019, 129 : 1 - 12