Multimodal Gesture Recognition Based on Choquet Integral

被引：0
|
作者：
Hirota, K. [1 ]
Vu, H. A. [1 ]
Le, P. Q. [1 ]
Fatichah, C. [1 ]
Liu, Z. [1 ]
Tang, Y. [1 ]
Tangel, M. L. [1 ]
Mu, Z. [1 ]
Sun, B. [1 ]
Yan, F. [1 ]
Masano, D. [1 ]
Thet, O. [1 ]
Yamaguchi, M. [1 ]
Dong, F. [1 ]
Yamazaki, Y. [2 ]
机构：
[1] Tokyo Inst Technol, Dept Computat Intelligence & Syst Sci, Yokohama, Kanagawa 227, Japan
[2] Kanto Gakuin Univ, Dept Electr Electron & Informat Engn, Yokohama, Kanagawa, Japan
来源：
IEEE INTERNATIONAL CONFERENCE ON FUZZY SYSTEMS (FUZZ 2011) | 2011年
关键词：
Gesture Recognition; Sensor Fusion; Choquet Integral; Human-Robot Interaction; 3D Accelerometer;
D O I：
暂无
中图分类号：
TP18 [人工智能理论];
学科分类号：
081104 ; 0812 ; 0835 ; 1405 ;
摘要：
A multimodal gesture recognition method is proposed based on Choquet integral by fusing information from camera and 3D accelerometer data. By calculating the optimal fuzzy measures for the camera recognition module and the accelerometer recognition module, the proposal obtains enough recognition rate 92.7% in average for 8 types of gestures by improving the recognition rate approximate 20% compared to that of each module. The proposed method aims to realize the casual communication from humans to robots by integrating nonverbal gesture messages and verbal messages.
引用
收藏
页码：772 / 776
页数：5
相关论文
共 50 条
  • [1] Multimodal Gesture Recognition for Mascot Robot System Based on Choquet Integral Using Camera and 3D Accelerometers Fusion
    Tang, Yongkang
    Vu, Hai An
    Le, Phuc Q.
    Masano, Daisuke
    Thet, Oo Han
    Fatichah, Chastine
    Liu, Zhentao
    Yamaguchi, Masashi
    Tangel, Martin Leonard
    Dong, Fangyan
    Yamazaki, Yoichi
    Hirota, Kaoru
    JOURNAL OF ADVANCED COMPUTATIONAL INTELLIGENCE AND INTELLIGENT INFORMATICS, 2011, 15 (05) : 563 - 572
  • [2] Generalized Choquet Integral for Face Recognition
    Paweł Karczmarek
    Adam Kiersztyn
    Witold Pedrycz
    International Journal of Fuzzy Systems, 2018, 20 : 1047 - 1055
  • [3] Generalized Choquet Integral for Face Recognition
    Karczmarek, Pawel
    Kiersztyn, Adam
    Pedrycz, Witold
    INTERNATIONAL JOURNAL OF FUZZY SYSTEMS, 2018, 20 (03) : 1047 - 1055
  • [4] Gesture recognition based on multilevel multimodal feature fusion
    Tian, Jinrong
    Cheng, Wentao
    Sun, Ying
    Li, Gongfa
    Jiang, Du
    Jiang, Guozhang
    Tao, Bo
    Zhao, Haoyi
    Chen, Disi
    JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2020, 38 (03) : 2539 - 2550
  • [5] Challenges in multimodal gesture recognition
    Escalera, Sergio
    Athitsos, Vassilis
    Guyon, Isabelle
    JOURNAL OF MACHINE LEARNING RESEARCH, 2016, 17
  • [6] Multimodal Dynamic Networks for Gesture Recognition
    Wu, Di
    Shao, Ling
    PROCEEDINGS OF THE 2014 ACM CONFERENCE ON MULTIMEDIA (MM'14), 2014, : 945 - 948
  • [7] Classification based on Choquet integral
    Yang, Rong
    Ouyang, Ren
    JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2014, 27 (04) : 1693 - 1702
  • [8] Choquet Integral-based Multimodal Fusion Strategy in the Application of Atherosclerosis Risk Prediction
    Xue, Yi-Hang
    Chen, Rui
    Wang, Jian-Guo
    Chang, Daoduo
    Yao, Yuan
    Chen, He-Lin
    2023 IEEE 12TH DATA DRIVEN CONTROL AND LEARNING SYSTEMS CONFERENCE, DDCLS, 2023, : 1847 - 1852
  • [9] Pattern Recognition Based on Hierarchical Description of Decision Rules Using Choquet Integral
    Santosh, K. C.
    Wendling, Laurent
    RECENT TRENDS IN IMAGE PROCESSING AND PATTERN RECOGNITION (RTIP2R 2016), 2017, 709 : 146 - 158
  • [10] Gesture recognition using Integral Imaging
    Pla, Filiberto
    Latorre-Carmona, Pedro
    Salvador-Balaguer, Eva
    Javidi, Bahram
    2017 16TH WORKSHOP ON INFORMATION OPTICS (WIO), 2017,
12345