Comparing 3D trajectories for simple mid-air gesture recognition

被引:16
|
作者
Caputo, Fabio M. [1 ]
Prebianca, Pietro [1 ]
Carcangiu, Alessandro [2 ]
Spano, Lucio D. [3 ]
Giachetti, Andrea [1 ]
机构
[1] Univ Verona, Dept Comp Sci, I-37134 Verona, Italy
[2] Univ Cagliari, Dept Elect & Elect Engn, I-09123 Cagliari, Italy
[3] Univ Cagliari, Dept Math & Informat Technol, I-09124 Cagliari, Italy
来源
COMPUTERS & GRAPHICS-UK | 2018年 / 73卷
关键词
Gestures recognition; Trajectory matching; Classification; Mid-air gestures; Gestures dataset;
D O I
10.1016/j.cag.2018.02.009
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
User interfaces based on mid-air gesture recognition are expected to become popular in the near future due to the increasing diffusion of virtual, mixed reality applications and smart devices. The design of this kind of interfaces would be clearly helped by the availability of simple and effective methods to compare short 3D trajectories, allowing fast and accurate recognition of command gestures given a few examples. This approach, quite popular in 2D touch-based interfaces with the so-called "dollar" algorithm family, has not been deeply investigated for 3D mid-air gestures. In this paper, we explore several metrics that can be used for mid-air gesture comparison and present experimental tests performed to analyze their effectiveness on practical tasks. By adopting smart choices in gesture traces processing and comparing, it was possible to obtain very good results in the retrieval and recognition of simple command gestures, from complete or even partial hand trajectories. The approach was also extended in order to recognize gestures characterized by both hand and finger motions and tested on a recent benchmark, reaching state of the art performances. (C) 2018 Elsevier Ltd. All rights reserved.
引用
收藏
页码:17 / 25
页数:9
相关论文
共 50 条
  • [1] Nonlinear dynamic analysis of mid-air gesture recognition
    Feng G.
    Hou W.
    Zhou H.
    You Z.
    Jisuanji Jicheng Zhizao Xitong/Computer Integrated Manufacturing Systems, CIMS, 2020, 26 (08): : 2116 - 2123
  • [2] Simulating Realistic Human Motion Trajectories of Mid-Air Gesture Typing
    Shen, Junxiao
    Dudley, John
    Kristensson, Per Ola
    2021 IEEE INTERNATIONAL SYMPOSIUM ON MIXED AND AUGMENTED REALITY (ISMAR 2021), 2021, : 393 - 402
  • [3] 3D Tabletop AR: A Comparison of Mid-Air, Touch and Touch plus Mid-Air Interaction
    Plasson, Carole
    Cunin, Dominique
    Laurillau, Yann
    Nigay, Laurence
    PROCEEDINGS OF THE WORKING CONFERENCE ON ADVANCED VISUAL INTERFACES AVI 2020, 2020,
  • [4] Fast and Robust Mid-Air Gesture Typing for AR Headsets using 3D Trajectory Decoding
    Shen, Junxiao
    Dudley, John
    Kristensson, Per Ola
    IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2023, 29 (11) : 4622 - 4632
  • [5] ChAirGest - A Challenge for Multimodal Mid-Air Gesture Recognition for Close HCI
    Ruffieux, Simon
    Lalanne, Denis
    Mugellini, Elena
    ICMI'13: PROCEEDINGS OF THE 2013 ACM INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION, 2013, : 483 - 488
  • [6] Mid-Air Haptic Algorithms for Rendering 3D Shapes
    Martinez, Jonatan
    Harwood, Adam
    Limerick, Hannah
    Clark, Rory
    Georgiou, Orestis
    2019 IEEE INTERNATIONAL SYMPOSIUM ON HAPTIC AUDIO-VISUAL ENVIRONMENTS & GAMES (HAVE 2019), 2019,
  • [7] A Mid-Air Gestural Controller for the Pyramix® 3D panner
    Quiroz, Diego
    2018 AES INTERNATIONAL CONFERENCE ON SPATIAL REPRODUCTION - AESTHETICS AND SCIENCE, 2018,
  • [8] Mid-air interaction with optical tracking for 3D modeling
    Cui, Jian
    Sourin, Alexei
    COMPUTERS & GRAPHICS-UK, 2018, 74 : 1 - 11
  • [9] Gesture-ProxylessNAS: A Lightweight Network for Mid-Air Gesture Recognition Based on UWB Radar
    Qiao, Lihong
    Li, Zhixin
    Xiao, Bin
    Shu, Yucheng
    Li, Weisheng
    Gao, Xinbo
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2023, 16 : 5144 - 5153
  • [10] A gesture-free geometric approach for mid-air expression of design intent in 3D virtual pottery
    Vinayak
    Ramani, Karthik
    COMPUTER-AIDED DESIGN, 2015, 69 : 11 - 24