Incorporating tilt-based interaction in multimodal user interfaces for mobile devices

被引:0
|
作者
Mantyjarvi, Jani [1 ]
Paterno, Fabio [2 ]
Santoro, Carmen [2 ]
机构
[1] VTT Tech Res Ctr, Kaitovayla 1, Oulu 90571, Finland
[2] ISTI, CNR, I-56124 Pisa, Italy
来源
TASK MODELS AND DIAGRAMS FOR USERS INTERFACE DESIGN | 2007年 / 4385卷
关键词
model-based design of user interfaces; gestural interfaces for mobile devices; tilt interfaces;
D O I
暂无
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Emerging ubiquitous environments raise the need to support multiple interaction modalities in diverse types of devices. Designing multimodal interfaces for ubiquitous environments using development tools creates challenges since target platforms support different resources and interfaces. Model-based approaches have been recognized as useful for managing the increasing complexity consequent to the many available interaction platforms. However, they have usually focused on graphical and/or vocal modalities. This paper presents a solution for enabling the development of tilt-based hand gesture and graphical modalities for mobile devices in a multimodal user interface development tool. The challenges related to developing gesture-based applications for various types of devices involving mobile devices are discussed in detail. The possible solution presented is based. on a logical description language for hand-gesture user interfaces. Such language allows us to obtain a user interface implementation on the target mobile platform. The solution is illustrated with an example application that can be accessed from both the desktop and mobile device supporting tilt-based gesture interaction.
引用
收藏
页码:230 / +
页数:3
相关论文
empty
未找到相关数据