MID-AIR GESTURE FOR MULTI-FINGER CONTROL SYSTEM USING LEAP MOTION ROBOT

被引:0
|
作者
Muthukrishnan, M. [1 ]
Ram, G. Shree [1 ]
Vijayalakshmi, G. [1 ]
机构
[1] Prince Shri Venkateshwara Padmavathy Engn Coll, Dept Elect & Commun Engn, Chennai 12, Tamil Nadu, India
关键词
Leap Motion Sensor; Hand Gesture Recognition; Man-machine Interaction; Natural user Interface; KW WIND TURBINE; VIBRATION; VIDEO;
D O I
10.9756/INTJECSE/V14I5.38
中图分类号
G76 [特殊教育];
学科分类号
040109 ;
摘要
In our work, the main aim of a making human hand tracking system is to create interaction between human hand and Robotic Module. Human-machine interaction gives the relation between human and computer. The Robotic system is to be controlled using Leap motion controller in X, Y and Z direction. The Leap Motion Sensor is a small device able to sense human hands above it and try to keep track of them. Hence, when controlling the robot, the user can use touch-free control experience. A mobile robot can be controlled by translating the multi-finger gestures into commands via leap motion controller. In this work the hand gestures are observed and transferred to the computer. Then by translating the input leap motion signals into commands we can control the robot. The main technology behind leap is normal user interface, gesture recognition and motion control. However, we cannot achieve the capability of a human hand completely, this system can be used in all the areas where robotic hands are manually controlled and reduces much of effort and being used while handling with traditional controllers.
引用
收藏
页码:388 / 397
页数:10
相关论文
共 50 条
  • [1] Investigating the Dexterity of Multi-Finger Input for Mid-Air Text Entry
    Sridhar, Srinath
    Feit, Anna Maria
    Theobalt, Christian
    Oulasvirta, Antti
    CHI 2015: PROCEEDINGS OF THE 33RD ANNUAL CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS, 2015, : 3643 - 3652
  • [2] Hand Gesture Based Robot Control System Using Leap Motion
    Chen, Sunjie
    Ma, Hongbin
    Yang, Chenguang
    Fu, Mengyin
    INTELLIGENT ROBOTICS AND APPLICATIONS, ICIRA 2015, PT I, 2015, 9244 : 581 - 591
  • [3] Mid-Air Gestures for Virtual Modeling with Leap Motion
    Cui, Jian
    Fellner, Dieter W.
    Kuijper, Arjan
    Sourin, Alexei
    DISTRIBUTED, AMBIENT AND PERVASIVE INTERACTIONS, (DAPI 2016), 2016, 9749 : 221 - 230
  • [4] Enabling Mid-air Browser Interaction with Leap Motion
    Boudjelthia, Assam
    Nasim, Sofeem
    Eskola, Janne
    Adeegbe, Joshua Muyiwa
    Hourula, Oula
    Klakegg, Simon
    Ferreira, Denzil
    PROCEEDINGS OF THE 2018 ACM INTERNATIONAL JOINT CONFERENCE ON PERVASIVE AND UBIQUITOUS COMPUTING AND PROCEEDINGS OF THE 2018 ACM INTERNATIONAL SYMPOSIUM ON WEARABLE COMPUTERS (UBICOMP/ISWC'18 ADJUNCT), 2018, : 335 - 338
  • [5] Natural Gesture Control of a Delta Robot Using Leap Motion
    Zhang, Xuchong
    Zhang, Ruiqiu
    Chen, Liang
    Zhang, Xianmin
    2018 INTERNATIONAL SYMPOSIUM ON POWER ELECTRONICS AND CONTROL ENGINEERING (ISPECE 2018), 2019, 1187
  • [6] AirTyping: A Mid-Air Typing Scheme based on Leap Motion
    Zhang, Hao
    Yin, Yafeng
    Xie, Lei
    Lu, Sanglu
    UBICOMP/ISWC '20 ADJUNCT: PROCEEDINGS OF THE 2020 ACM INTERNATIONAL JOINT CONFERENCE ON PERVASIVE AND UBIQUITOUS COMPUTING AND PROCEEDINGS OF THE 2020 ACM INTERNATIONAL SYMPOSIUM ON WEARABLE COMPUTERS, 2020, : 168 - 171
  • [7] Propositions for a Mid-Air Interactions System Using Leap-Motion for a Collaborative Omnidirectional Immersive Environment
    Vivian, Robin
    DISTRIBUTED, AMBIENT AND PERVASIVE INTERACTIONS, DAPI 2017, 2017, 10291 : 203 - 216
  • [8] Controlling Robot Vehicle Using Hand-Gesture with Mid-Air Haptic Feedback
    Morisaki, Tao
    Fujiwara, Masahiro
    Makino, Yasutoshi
    Shinoda, Hiroyuki
    HAPTIC INTERACTION: PERCEPTION, DEVICES AND ALGORITHMS, 2019, 535 : 268 - 271
  • [9] Multi-input of Touch, Pen and Mid-Air Gesture
    Xin Y.
    Jiang X.
    Li Y.
    Li Y.
    2018, Institute of Computing Technology (30): : 957 - 967
  • [10] Mid-air Motion Planning of Floating Robot Using Heat Flow Method
    Fan, Yinai
    Liu, Shenyu
    Belabbas, Mohamed-Ali
    IFAC PAPERSONLINE, 2019, 52 (22): : 19 - 24