A Method for Underwater Human-Robot Interaction Based on Gestures Tracking with Fuzzy Control

被引:8
|
作者
Jiang, Yu [1 ,2 ]
Zhao, Minghao [1 ,2 ]
Wang, Chong [1 ]
Wei, Fenglin [1 ]
Qi, Hong [1 ,2 ]
机构
[1] Jilin Univ, Coll Comp Sci & Technol, Changchun 130012, Peoples R China
[2] Jilin Univ, Minist Educ, Key Lab Symbol Computat & Knowledge Engn, Changchun 130012, Peoples R China
基金
中国国家自然科学基金;
关键词
Fuzzy control; Gesture recognition; Human-robot interaction; Autonomous underwater vehicle; ALGORITHM;
D O I
10.1007/s40815-021-01086-x
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Working in collaboration with an Autonomous Underwater Vehicle is a new working method for divers. Using gestures to give instructions for the diver is a simple and effective mode of underwater human-robot interaction (HRI). In this paper, a gestures tracking method for under human-robot interaction based on fuzzy control is proposed. Firstly, four object recognition algorithms in terms of gesture recognition are compared. YOLO V4-tiny was an extremely high performance, as the gesture area recognition algorithm. We propose a model based on Siamese Network for gesture classification. A gesture tracking method based on fuzzy control is proposed, analyzing the image from AUV front camera to establish a 3D fuzzy rule set. This method can realize the self-regulation of AUV and keep the diver's gestures in the camera view. The experiment result shows the efficiency of the proposed method.
引用
收藏
页码:2170 / 2181
页数:12
相关论文
共 50 条
  • [1] A Method for Underwater Human–Robot Interaction Based on Gestures Tracking with Fuzzy Control
    Yu Jiang
    Minghao Zhao
    Chong Wang
    Fenglin Wei
    Hong Qi
    International Journal of Fuzzy Systems, 2021, 23 : 2170 - 2181
  • [2] An Underwater Human-Robot Interaction Using Hand Gestures for Fuzzy Control
    Jiang, Yu
    Peng, Xianglong
    Xue, Mingzhu
    Wang, Chong
    Qi, Hong
    INTERNATIONAL JOURNAL OF FUZZY SYSTEMS, 2021, 23 (06) : 1879 - 1889
  • [3] An Underwater Human–Robot Interaction Using Hand Gestures for Fuzzy Control
    Yu Jiang
    Xianglong Peng
    Mingzhu Xue
    Chong Wang
    Hong Qi
    International Journal of Fuzzy Systems, 2021, 23 : 1879 - 1889
  • [4] Human-Robot Interaction Based on Gestures for Service Robots
    de Sousa, Patrick
    Esteves, Tiago
    Campos, Daniel
    Duarte, Fabio
    Santos, Joana
    Leao, Joao
    Xavier, Jose
    de Matos, Luis
    Camarneiro, Manuel
    Penas, Marcelo
    Miranda, Maria
    Silva, Ricardo
    Neves, Antonio J. R.
    Teixeira, Luis
    VIPIMAGE 2017, 2018, 27 : 700 - 709
  • [5] Pantomimic Gestures for Human-Robot Interaction
    Burke, Michael
    Lasenby, Joan
    IEEE TRANSACTIONS ON ROBOTICS, 2015, 31 (05) : 1225 - 1237
  • [6] Conversational Gestures in Human-Robot Interaction
    Bremner, Paul
    Pipe, Anthony
    Melhuish, Chris
    Fraser, Mike
    Subramanian, Sriram
    2009 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN AND CYBERNETICS (SMC 2009), VOLS 1-9, 2009, : 1645 - +
  • [7] Understanding human motion and gestures for underwater human-robot collaboration
    Islam, Md Jahidul
    Ho, Marc
    Sattar, Junaed
    JOURNAL OF FIELD ROBOTICS, 2019, 36 (05) : 851 - 873
  • [8] Human-Robot Interaction Based on Gaze Gestures for the Drone Teleoperation
    Yu, Mingxin
    Lin, Yingzi
    Schmidt, David
    Wang, Xiangzhou
    Wang, Yu
    JOURNAL OF EYE MOVEMENT RESEARCH, 2014, 7 (04):
  • [9] Analysis of Task-Based Gestures in Human-Robot Interaction
    Haddadi, Amir
    Croft, Elizabeth A.
    Gleeson, Brian T.
    MacLean, Karon
    Alcazar, Javier
    2013 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2013, : 2146 - 2152
  • [10] Fuzzy Automaton based Human-Robot Interaction
    Kovacs, Szilveszter
    Vincze, David
    Gacsi, Marta
    Miklosi, Adam
    Korondi, Peter
    2010 IEEE 8TH INTERNATIONAL SYMPOSIUM ON APPLIED MACHINE INTELLIGENCE AND INFORMATICS, 2010, : 165 - +