Joint Intent Detection and Slot Filling via CNN-LSTM-CRF

被引:0
作者
Kane, Bamba [1 ]
Rossi, Fabio [1 ]
Guinaudeau, Ophelie [1 ]
Chiesa, Valeria [1 ]
Quenel, Ilhem [1 ]
Chau, Stephan [1 ]
机构
[1] Altran, Res & Innovat Direct, Sophia Antipolis, France
来源
2020 6TH IEEE CONGRESS ON INFORMATION SCIENCE AND TECHNOLOGY (IEEE CIST'20) | 2020年
关键词
Spoken Language Understanding; Intent detection; Slot filling; Recurrent Neural Networks; Convolutional Neural Networks; CONVOLUTIONAL NEURAL-NETWORKS;
D O I
10.1109/CIST49399.2021.9357183
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Intent detection and slot filling are two main tasks in the domain of Spoken Language Understanding (SLU). The methods employed may treat the intent detection and slot filling as two independent tasks or use a joint model. Using a joint model takes into account the cross impact between the two tasks. In this article, we introduce CoBiC a new model combining CNN (Convolutional Neural Network), Bidirectional LSTM (Long Short-Term Memory) and CRF (Conditional Random Field) to extract the intents and the related slots. The same architecture of CoBiC can either be used as an independent model or joint model for intent detection and slot filling. Our method improves the state-of-the-art results on ATIS (Airline Travel Information Systems) benchmark. We also apply our model on a private dataset consisting of clients requests to a vocal assistant. The results demonstrate that CoBiC has strong generalization capability.
引用
收藏
页码:342 / 347
页数:6
相关论文
共 33 条
  • [1] LEARNING LONG-TERM DEPENDENCIES WITH GRADIENT DESCENT IS DIFFICULT
    BENGIO, Y
    SIMARD, P
    FRASCONI, P
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS, 1994, 5 (02): : 157 - 166
  • [2] Calkins H, 2017, J ARRYTHM, V33, P369, DOI 10.1016/j.joa.2017.08.001
  • [3] Chen Qian, 2019, BERT for joint intent classification and slot filling
  • [4] Devlin J, 2019, 2019 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES (NAACL HLT 2019), VOL. 1, P4171
  • [5] A Multi-Task Hierarchical Approach for Intent Detection and Slot Filling
    Firdaus, Mauajama
    Kumar, Ankit
    Ekbal, Asif
    Bhattacharyya, Pushpak
    [J]. KNOWLEDGE-BASED SYSTEMS, 2019, 183
  • [6] Goo C. W., 2018, P 2018 C N AM CHAPTE, V2
  • [7] Guo D, 2014, IEEE W SP LANG TECH, P554, DOI 10.1109/SLT.2014.7078634
  • [8] Gupta Arshit, 2019, 20TH ANNUAL MEETING OF THE SPECIAL INTEREST GROUP ON DISCOURSE AND DIALOGUE (SIGDIAL 2019), P46
  • [9] Multi-Domain Joint Semantic Frame Parsing using Bi-directional RNN-LSTM
    Hakkani-Tur, Dilek
    Tur, Gokhan
    Celikyilmaz, Asli
    Chen, Yun-Nung
    Gao, Jianfeng
    Deng, Li
    Wang, Ye-Yi
    [J]. 17TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2016), VOLS 1-5: UNDERSTANDING SPEECH PROCESSING IN HUMANS AND MACHINES, 2016, : 715 - 719
  • [10] Hochreiter S., 1997, NEURAL COMPUT, V9, P1735, DOI DOI 10.1162/NECO.1997.9.8.1735