Multimodal Gesture Recognition Based on Choquet Integral

被引：0

作者：

Hirota, K. ^{[1
]}

Vu, H. A. ^{[1
]}

Le, P. Q. ^{[1
]}

Fatichah, C. ^{[1
]}

Liu, Z. ^{[1
]}

Tang, Y. ^{[1
]}

Tangel, M. L. ^{[1
]}

Mu, Z. ^{[1
]}

Sun, B. ^{[1
]}

Yan, F. ^{[1
]}

Masano, D. ^{[1
]}

Thet, O. ^{[1
]}

Yamaguchi, M. ^{[1
]}

Dong, F. ^{[1
]}

Yamazaki, Y. ^{[2
]}

机构：

[1] Tokyo Inst Technol, Dept Computat Intelligence & Syst Sci, Yokohama, Kanagawa 227, Japan

[2] Kanto Gakuin Univ, Dept Electr Electron & Informat Engn, Yokohama, Kanagawa, Japan

来源：

IEEE INTERNATIONAL CONFERENCE ON FUZZY SYSTEMS (FUZZ 2011) | 2011年

关键词：

Gesture Recognition; Sensor Fusion; Choquet Integral; Human-Robot Interaction; 3D Accelerometer;

D O I：

暂无

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

A multimodal gesture recognition method is proposed based on Choquet integral by fusing information from camera and 3D accelerometer data. By calculating the optimal fuzzy measures for the camera recognition module and the accelerometer recognition module, the proposal obtains enough recognition rate 92.7% in average for 8 types of gestures by improving the recognition rate approximate 20% compared to that of each module. The proposed method aims to realize the casual communication from humans to robots by integrating nonverbal gesture messages and verbal messages.

引用

页码：772 / 776

页数：5

共 50 条

[11] A Multimodal Fusion Model Based on Hybrid Attention Mechanism for Gesture Recognition
Li, Yajie
Chen, Yiqiang
Gu, Yang
Ouyang, Jianquan
STRUCTURAL, SYNTACTIC, AND STATISTICAL PATTERN RECOGNITION, S+SSPR 2020, 2021, 12644 : 302 - 312
[12] Seeking a Hierarchical Prototype for Multimodal Gesture Recognition
Li, Yunan
Qi, Tianyu
Ma, Zhuoqi
Quan, Dou
Miao, Qiguang
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2025, 36 (01) : 198 - 209
[13] Seeking a Hierarchical Prototype for Multimodal Gesture Recognition
Li, Yunan
Qi, Tianyu
Ma, Zhuoqi
Quan, Dou
Miao, Qiguang
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, : 1 - 12
[14] Gesture Recognition in Robotic Surgery With Multimodal Attention
van Amsterdam, Beatrice
Funke, Isabel
Edwards, Eddie
Speidel, Stefanie
Collins, Justin
Sridhar, Ashwin
Kelly, John
Clarkson, Matthew J.
Stoyanov, Danail
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2022, 41 (07) : 1677 - 1687
[15] Property valuation based on Choquet integral
Ozdilek, Unsal
COMPUTATIONAL & APPLIED MATHEMATICS, 2020, 39 (02)
[16] Property valuation based on Choquet integral
Ünsal Özdilek
Computational and Applied Mathematics, 2020, 39
[17] A Multimodal Dynamic Hand Gesture Recognition Based on Radar-Vision Fusion
Liu, Haoming
Liu, Zhenyu
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72
[18] Bayesian Inference Based Choquet Integral Method
Ren, Chunxiao
COMPUTER VISION, PT III, 2017, 773 : 401 - 415
[19] Multimodal multilevel attention for semi-supervised skeleton-based gesture recognition
Liu, Jinting
Gan, Minggang
He, Yuxuan
Guo, Jia
Hu, Kang
COMPLEX & INTELLIGENT SYSTEMS, 2025, 11 (04)
[20] A Trajectory-Based Approach for Device Independent Gesture Recognition in Multimodal User Interfaces
Wilhelm, Mathias
Roscher, Dirk
Blumendorf, Marco
Albayrak, Sahin
HAPTIC AND AUDIO INTERACTION DESIGN, 2010, 6306 : 197 - 206

← 1 2 3 4 5 →