QuickSet: Multimodal interaction for distributed applications

被引：132

作者：

Cohen, PR ^{[1
]}

Johnston, M ^{[1
]}

McGee, D ^{[1
]}

Oviatt, S ^{[1
]}

Pittman, J ^{[1
]}

Smith, I ^{[1
]}

Chen, L ^{[1
]}

Clow, J ^{[1
]}

机构：

[1] Oregon Grad Inst Sci & Technol, Ctr Human Comp Commun, Portland, OR 97291 USA

来源：

ACM MULTIMEDIA 97, PROCEEDINGS | 1997年

关键词：

multimodal interfaces; agent architecture; gesture recognition; speech recognition; natural language processing; distributed interactive simulation;

D O I：

10.1145/266180.266328

中图分类号：

TP [自动化技术、计算机技术];

学科分类号：

0812 ;

摘要：

This paper presents an emerging application of multimodal interface research to distributed applications. We have developed the Quickset prototype, a pen/voice system running on a band-held PC, communicating via wireless LAN through an agent architecture to a number of systems, including NRaD's(1) LeatherNet system, a distributed interactive training simulator built for the US Marine Corps. The paper describes the overall system architecture, a novel multimodal integration strategy offering mutual compensation among modalities, and provides examples of multimodal simulation setup. Finally, we discuss our applications experience and evaluation.

引用

页码：31 / 40

页数：10

共 50 条

[1] Embodied conversational agents in Wizard-of-Oz and multimodal interaction applications
Rojc, Matej
Rotovnik, Tomaz
Brus, Miso
Jan, Dusan
Kacic, Zdravko
VERBAL AND NONVERBAL COMMUNICATION BEHAVIOURS, 2007, 4775 : 294 - +
[2] Distributed interactive simulation using multimodal interfaces - An experience
ManjuG
Idicula, SM
Peter, D
MSV'04 & AMCS'04, PROCEEDINGS, 2004, : 252 - 259
[3] Multimodal interaction system for home appliances control
Fakhrurroja H.
Machbub C.
Prihatmanto A.S.
Purwarianti A.
International Journal of Interactive Mobile Technologies, 2020, 14 (15) : 44 - 67
[4] GeoMap: Development of a Geospatial Application with Multimodal Interaction
Espino Gallegos, Alex
Melendez Acosta, Ulices
Barrientos Padilla, Alfredo
Shiguihara-Juarez, Pedro
2018 CONGRESO INTERNACIONAL DE INNOVACION Y TENDENCIAS EN INGENIERIA (CONIITI), 2018,
[5] Multimodal Framework for Mobile Interaction
Cutugno, Francesco
Leano, Vincenza Anna
Mignini, Gianluca
Rinaldi, Roberto
PROCEEDINGS OF THE INTERNATIONAL WORKING CONFERENCE ON ADVANCED VISUAL INTERFACES, 2012, : 197 - 203
[6] Multimodal Interaction for Mobile Learning
Kondratova, Irina
UNIVERSAL ACCESS IN HUMAN-COMPUTER INTERACTION, PT II, PROCEEDINGS: INTELLIGENT AND UBIQUITOUS INTERACTION ENVIRONMENTS, 2009, 5615 : 327 - 334
[7] MIMOSE: multimodal interaction for music orchestration sheet editors An integrable multimodal music editor interaction system
Coletta, Andrea
De Marsico, Maria
Panizzi, Emanuele
Prenkaj, Bardh
Silvestri, Domenicomichele
MULTIMEDIA TOOLS AND APPLICATIONS, 2019, 78 (23) : 33041 - 33068
[8] MIMOSE: multimodal interaction for music orchestration sheet editorsAn integrable multimodal music editor interaction system
Andrea Coletta
Maria De Marsico
Emanuele Panizzi
Bardh Prenkaj
Domenicomichele Silvestri
Multimedia Tools and Applications, 2019, 78 : 33041 - 33068
[9] The Use of Multimodal Interaction for Supporting the Production of Location-Based Information
Horita, F. E. A.
Braga, D. S.
Monteiro, C. D. D.
IEEE LATIN AMERICA TRANSACTIONS, 2016, 14 (07) : 3496 - 3502
[10] Multimodal Interaction for Real and Virtual Environments
Murthy, L. R. D.
PROCEEDINGS OF THE 25TH INTERNATIONAL CONFERENCE ON INTELLIGENT USER INTERFACES COMPANION (IUI'20), 2020, : 29 - 30

← 1 2 3 4 5 →