Natural user interface for ambient objects

被引:2
|
作者
Ma, Meng [1 ]
Merckx, Kevin [1 ]
Fallavollita, Pascal [1 ]
Navab, Nassir [1 ,2 ]
机构
[1] Tech Univ Munich, Munich, Germany
[2] Johns Hopkins Univ, Baltimore, MD 21218 USA
来源
2015 IEEE INTERNATIONAL SYMPOSIUM ON MIXED AND AUGMENTED REALITY | 2015年
关键词
H.1.2 [Human-centered computing]: Human computer interaction (HCI); Life Cycle; H.1.2 [Human-centered computing]: Interaction design process and methods; Interaction Design;
D O I
10.1109/ISMAR.2015.25
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
To help the computing device always understand the spacial relationship between the user's gesture and the ambient objects, a methodology is proposed to find the user's virtual eye center in the wearable camera coordinate system and then calculate accurately where a user is pointing at to perform the natural interaction. First, the wearable RGB-D sensor is affixed around the user forehead. A tool-free calibration is done by having the user move their fingers along their lines of sight from his eye center to the random selected targets. The fingertips are detected in the depth camera and then the interaction of these lines of sight is calculated. Then we present how to find where the user is pointing at in different scenarios with a depth map, a detected object and a controlled virtual element. To validate our methods, we perform a point-to-screen experiment. Results demonstrate that when a user is interacting with a display up to 1.5 meters away, our natural gesture interface has an average error of 2.1cm. In conclusion, the presented technique is a viable option for a reliable user interaction.
引用
收藏
页码:76 / 79
页数:4
相关论文
共 36 条
  • [1] Natural User Interface Design for Digital Painting Based on User Behavior Patterns
    Shen, Jing
    Chen, Liang
    Qin, Zhi-nan
    He, Wei-jing
    INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND COMPUTER SCIENCE (AICS 2016), 2016, : 183 - 187
  • [2] User interface design as systems design
    Thimbleby, H
    Blandford, A
    Cairns, P
    Curzon, P
    Jones, M
    PEOPLE AND COMPUTERS XVI- MEMORABLE YET INVISIBLE, PROCEEDINGS, 2002, : 281 - 301
  • [3] A Comparative Research on Usability and User Experience of User Interface Design Software
    Wang, Junfeng
    Xu, Zhiyu
    Wang, Xi
    Lu, Jingjing
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2022, 13 (08) : 21 - 29
  • [4] Adaptive user interfaces and universal usability through plasticity of user interface design
    Miraz, Mahdi H.
    Ali, Maaruf
    Excell, Peter S.
    COMPUTER SCIENCE REVIEW, 2021, 40 (40)
  • [5] Semantic Search User Interface Patterns : An Introduction
    Marx, Edgard
    Khalili, Ali
    Valdestilhas, Andre
    25. INTERNATIONAL CONFERENCE IN CENTRAL EUROPE ON COMPUTER GRAPHICS, VISUALIZATION AND COMPUTER VISION (WSCG 2017), 2017, 2701 : 117 - 119
  • [6] STREET PORTALS: USER INTERFACE FOR BIKE SHARE
    Germany, Jason
    Speranza, Philip
    PROCEEDINGS OF THE INTERNATIONAL CONFERENCES ON ICT, SOCIETY AND HUMAN BEINGS 2015, WEB BASED COMMUNITIES AND SOCIAL MEDIA 2015 AND CONNECTED SMART CITIES 2015, 2015, : 157 - 166
  • [7] Usability evaluation of mobile devices user interface
    Aljedaibi, Wajdi
    Bashmail, Reem Mohammed
    NEXO REVISTA CIENTIFICA, 2021, 34 (04): : 1290 - 1300
  • [8] Towards Compromise User Experience Design in Ambient Intelligent Environment
    Ander, Veronika
    Cihelka, Petr
    Tyrychtr, Jan
    Novak, David
    AGRIS ON-LINE PAPERS IN ECONOMICS AND INFORMATICS, 2022, 14 (02) : 3 - 13
  • [9] Designing User Interface for Facilitating Live Editing in Streaming
    Tharatipyakul, Atima
    Li, Jie
    Cesar, Pablo
    CHI'20: EXTENDED ABSTRACTS OF THE 2020 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS, 2020,
  • [10] User interface prototyping methods in designing mobile handsets
    Kiljander, H
    HUMAN-COMPUTER INTERACTION - INTERACT '99, 1999, : 118 - 125