Comparing 3D trajectories for simple mid-air gesture recognition

被引：16

作者：

Caputo, Fabio M. ^{[1
]}

Prebianca, Pietro ^{[1
]}

Carcangiu, Alessandro ^{[2
]}

Spano, Lucio D. ^{[3
]}

Giachetti, Andrea ^{[1
]}

机构：

[1] Univ Verona, Dept Comp Sci, I-37134 Verona, Italy

[2] Univ Cagliari, Dept Elect & Elect Engn, I-09123 Cagliari, Italy

[3] Univ Cagliari, Dept Math & Informat Technol, I-09124 Cagliari, Italy

来源：

COMPUTERS & GRAPHICS-UK | 2018年 / 73卷

关键词：

Gestures recognition; Trajectory matching; Classification; Mid-air gestures; Gestures dataset;

D O I：

10.1016/j.cag.2018.02.009

中图分类号：

TP31 [计算机软件];

学科分类号：

081202 ; 0835 ;

摘要：

User interfaces based on mid-air gesture recognition are expected to become popular in the near future due to the increasing diffusion of virtual, mixed reality applications and smart devices. The design of this kind of interfaces would be clearly helped by the availability of simple and effective methods to compare short 3D trajectories, allowing fast and accurate recognition of command gestures given a few examples. This approach, quite popular in 2D touch-based interfaces with the so-called "dollar" algorithm family, has not been deeply investigated for 3D mid-air gestures. In this paper, we explore several metrics that can be used for mid-air gesture comparison and present experimental tests performed to analyze their effectiveness on practical tasks. By adopting smart choices in gesture traces processing and comparing, it was possible to obtain very good results in the retrieval and recognition of simple command gestures, from complete or even partial hand trajectories. The approach was also extended in order to recognize gestures characterized by both hand and finger motions and tested on a recent benchmark, reaching state of the art performances. (C) 2018 Elsevier Ltd. All rights reserved.

引用

页码：17 / 25

页数：9

共 50 条

[11] Heterogeneous hand gesture recognition using 3D dynamic skeletal data
De Smedt, Quentin
Wannous, Hazem
Vandeborre, Jean-Philippe
COMPUTER VISION AND IMAGE UNDERSTANDING, 2019, 181 : 60 - 72
[12] Coding Kendall's Shape Trajectories for 3D Action Recognition
Ben Tanfous, Amor
Drira, Hassen
Ben Amor, Boulbaba
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 2840 - 2849
[13] Framing the Design Space of Multimodal Mid-Air Gesture and Speech-Based Interaction With Mobile Devices for Older People
Mich, Ornella
Schiavo, Gianluca
Ferron, Michela
Mana, Nadia
INTERNATIONAL JOURNAL OF MOBILE HUMAN COMPUTER INTERACTION, 2020, 12 (01) : 22 - 41
[14] 3D human gesture capturing and recognition by the IMMU-based data glove
Fang, Bin
Sun, Fuchun
Liu, Huaping
Liu, Chunfang
NEUROCOMPUTING, 2018, 277 : 198 - 207
[15] Indoor Scene Recognition in 3D
Huang, Shengyu
Usvyatsov, Mikhail
Schindler, Konrad
2020 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2020, : 8041 - 8048
[16] A Real-time Multimodal Hand Gesture Recognition via 3D Convolutional Neural Network and Key Frame Extraction
Nguyen Ngoc Hoang
Lee, Guee-Sang
Kim, Soo-Hyung
Yang, Hyung-Jeong
PROCEEDINGS OF THE 2018 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND MACHINE INTELLIGENCE (MLMI 2018), 2018, : 32 - 37
[17] 3D Recognition: State of the Art and Trends
Orlova, S. R.
Lopata, A. V.
AUTOMATION AND REMOTE CONTROL, 2022, 83 (04) : 503 - 519
[18] Hierarchical matching of 3D pedestrian trajectories for surveillance applications
Piotto, Nicola
De Natale, Francesco G. B.
Conci, Nicola
AVSS: 2009 6TH IEEE INTERNATIONAL CONFERENCE ON ADVANCED VIDEO AND SIGNAL BASED SURVEILLANCE, 2009, : 146 - +
[19] A Survey of 3D Ear Recognition Techniques
Ganapathi, Iyyakutti Iyappan
Ali, Syed Sadaf
Prakash, Surya
Vu, Ngoc-Son
Werghi, Naoufel
ACM COMPUTING SURVEYS, 2023, 55 (10)
[20] 3D Texture Recognition for RGB-D Images
Zhong, Guoqiang
Mao, Xin
Shi, Yaxin
Dong, Junyu
COMPUTER ANALYSIS OF IMAGES AND PATTERNS, CAIP 2015, PT II, 2015, 9257 : 518 - 528

← 1 2 3 4 5 →