Toward hardware-aware deep-learning-based dialogue systems

被引:0
|
作者
Vlad Pandelea
Edoardo Ragusa
Tom Young
Paolo Gastaldo
Erik Cambria
机构
[1] Nanyang Technological University,School of Computer Science and Engineering
[2] University of Genoa,Department of Electrical, Electronic, Telecommunications Engineering and Naval Architecture, DITEN
来源
Neural Computing and Applications | 2022年 / 34卷
关键词
Dialogue systems; Natural language processing; Artificial intelligence;
D O I
暂无
中图分类号
学科分类号
摘要
In the past few years, the use of transformer-based models has experienced increasing popularity as new state-of-the-art performance was achieved in several natural language processing tasks. As these models are often extremely large, however, their use for applications within embedded devices may not be feasible. In this work, we look at one such specific application, retrieval-based dialogue systems, that poses additional difficulties when deployed in environments characterized by limited resources. Research on building dialogue systems able to engage in natural sounding conversation with humans has attracted increasing attention in recent years. This has led to the rise of commercial conversational agents, such as Google Home, Alexa and Siri situated on embedded devices, that enable users to interface with a wide range of underlying functionalities in a natural and seamless manner. In part due to memory and computational power constraints, these agents necessitate frequent communication with a server in order to process the users’ queries. This communication may act as a bottleneck, resulting in delays as well as in the halt of the system should the network connection be lost or unavailable. We propose a new framework for hardware-aware retrieval-based dialogue systems based on the Dual-Encoder architecture, coupled with a clustering method to group candidates pertaining to a same conversation, that reduces storage capacity and computational power requirements.
引用
收藏
页码:10397 / 10408
页数:11
相关论文
empty
未找到相关数据