Multimodal Gesture Recognition Based on Choquet Integral

被引：0

作者：

Hirota, K. ^{[1
]}

Vu, H. A. ^{[1
]}

Le, P. Q. ^{[1
]}

Fatichah, C. ^{[1
]}

Liu, Z. ^{[1
]}

Tang, Y. ^{[1
]}

Tangel, M. L. ^{[1
]}

Mu, Z. ^{[1
]}

Sun, B. ^{[1
]}

Yan, F. ^{[1
]}

Masano, D. ^{[1
]}

Thet, O. ^{[1
]}

Yamaguchi, M. ^{[1
]}

Dong, F. ^{[1
]}

Yamazaki, Y. ^{[2
]}

机构：

[1] Tokyo Inst Technol, Dept Computat Intelligence & Syst Sci, Yokohama, Kanagawa 227, Japan

[2] Kanto Gakuin Univ, Dept Electr Electron & Informat Engn, Yokohama, Kanagawa, Japan

来源：

IEEE INTERNATIONAL CONFERENCE ON FUZZY SYSTEMS (FUZZ 2011) | 2011年

关键词：

Gesture Recognition; Sensor Fusion; Choquet Integral; Human-Robot Interaction; 3D Accelerometer;

D O I：

暂无

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

A multimodal gesture recognition method is proposed based on Choquet integral by fusing information from camera and 3D accelerometer data. By calculating the optimal fuzzy measures for the camera recognition module and the accelerometer recognition module, the proposal obtains enough recognition rate 92.7% in average for 8 types of gestures by improving the recognition rate approximate 20% compared to that of each module. The proposed method aims to realize the casual communication from humans to robots by integrating nonverbal gesture messages and verbal messages.

引用

页码：772 / 776

页数：5

共 50 条

[21] Multimodal Fusion-GMM based Gesture Recognition for Smart Home by WiFi Sensing
Ding, Jianyang
Wang, Yong
Si, Hongyan
Ma, Jiannan
He, Jingwen
Liang, Kai
Fu, Shaozhong
2022 IEEE 95TH VEHICULAR TECHNOLOGY CONFERENCE (VTC2022-SPRING), 2022,
[22] A Hybrid Multimodal Fusion Framework for sEMG-ACC-Based Hand Gesture Recognition
Duan, Shengcai
Wu, Le
Xue, Bo
Liu, Aiping
Qian, Ruobing
Chen, Xun
IEEE SENSORS JOURNAL, 2023, 23 (03) : 2773 - 2782
[23] Choquet Integral on Multisets
Narukawa, Yasuo
Torra, Vicenc
INFORMATION PROCESSING AND MANAGEMENT OF UNCERTAINTY IN KNOWLEDGE-BASED SYSTEMS, PT I, 2014, 442 : 276 - 283
[24] CHOQUET INTEGRAL IN CAPACITY
Gal, Sorin G.
REAL ANALYSIS EXCHANGE, 2018, 43 (02) : 263 - 279
[25] The balancing Choquet integral
Mesiarova-Zemankova, A.
Mesiar, R.
Ahmad, K.
FUZZY SETS AND SYSTEMS, 2010, 161 (17) : 2243 - 2255
[26] Extending the Choquet integral
Rossi, Giovanni
NEW DIMENSIONS IN FUZZY LOGIC AND RELATED TECHNOLOGIES, VOL I, PROCEEDINGS, 2007, : 273 - 280
[27] Deep Dynamic Neural Networks for Multimodal Gesture Segmentation and Recognition
Wu, Di
Pigou, Lionel
Kindermans, Pieter-Jan
Nam Do-Hoang Le
Shao, Ling
Dambre, Joni
Odobez, Jean-Marc
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2016, 38 (08) : 1583 - 1597
[28] Approximation of Fuzzy Neural Networks Based on Choquet Integral
Cao, Shan
2015 12th International Conference on Fuzzy Systems and Knowledge Discovery (FSKD), 2015, : 35 - 38
[29] A Cosine Similarity Measure Based on the Choquet Integral for Intuitionistic Fuzzy Sets and Its Applications to Pattern Recognition
Olgun, Murat
Turkarslan, Ezgi
Unver, Mehmet
Ye, Jun
INFORMATICA, 2021, 32 (04) : 849 - 864
[30] Parameter Measurement Fusion Algorithm Based on Choquet Integral
Liu, Xuezhen
Yue, Shihong
Zhai, Lusheng
2021 IEEE INTERNATIONAL INSTRUMENTATION AND MEASUREMENT TECHNOLOGY CONFERENCE (I2MTC 2021), 2021,

← 1 2 3 4 5 →