Meal intention recognition system based on gaze direction estimation using deep learning for the user of meal assistant robot

被引：7
作者：
Park H. [1 ,2 ]
Jang I. [3 ]
Ko K. [1 ]
机构：
[1] Applied Robot R&D Department, Korea Institute of Industrial Technology
[2] Department of Computer Science & Engineering, Hanyang University
[3] Industry Academic Cooperation Foundation, Hankyong National University
来源：
Jang, Inhoon (inhuns@hknu.ac.kr); Ko, Kwangeun (kke0217@kitech.re.kr) | 2021年 / Institute of Control, Robotics and Systems卷 / 27期
关键词：
Deep learning; Gaze-direction recognition; Human-robot interaction; Meal-assistant robot;
D O I：
10.5302/J.ICROS.2021.21.0019
中图分类号：
学科分类号：
摘要：
Care robots that provide dietary supplements to the elderly and the disabled should be able to intelligently interact with the users’ intention to eat in real-time and provide the food they want. To this end, based on deep learning, we have developed a user interface that facilitates the selection of food to be eaten according to six user gaze directions. A single-stage object-detection deep learning model has been implemented as a lightweight, single-stage object-detection deep learning model that can be installed on commercial tablets, and the accuracy of this model was 0.9857. © ICROS 2021.
引用
收藏
页码：334 / 341
页数：7
相关论文
共 50 条
  • [1] A Meal-Assistance Robot System for Asian Food and Its Food Acquisition Point Estimation and User Interface Based on Face Recognition
    Choi, Iksu
    Ko, KwangEun
    Song, Hajun
    Jung, Byung-Jin
    Hwang, Jung-Hoon
    Moon, Hyungpil
    Yang, Gi-Hun
    APPLIED SCIENCES-BASEL, 2023, 13 (05):
  • [2] Automatic Cashier System Based on Meal Plate Detection Using Deep Learning
    Zheng, Weibin
    Peng, Shengliang
    Chen, Qilong
    Ouyang, Hao
    Lin, Shiheng
    PROCEEDINGS OF THE 2017 2ND INTERNATIONAL SYMPOSIUM ON ADVANCES IN ELECTRICAL, ELECTRONICS AND COMPUTER ENGINEERING (ISAEECE 2017), 2017, 124 : 413 - 418
  • [3] Visual Intention Classification by Deep Learning for Gaze-based Human-Robot Interaction
    Shi, Lei
    Copot, Cosmin
    Vanlanduit, Steve
    IFAC PAPERSONLINE, 2020, 53 (05): : 750 - 755
  • [4] Mouse dynamics based user recognition using deep learning
    Antal, Margit
    Fejer, Norbert
    ACTA UNIVERSITATIS SAPIENTIAE INFORMATICA, 2020, 12 (01) : 39 - 50
  • [5] Gaze Estimation Based on Head Movements in Virtual Reality Applications using Deep Learning
    Soccini, Agata Marta
    2017 IEEE VIRTUAL REALITY (VR), 2017, : 413 - 414
  • [6] Deep Learning based Command Pointing direction estimation using a single RGB Camera
    Jaiswal, Shruti
    Mishra, Pratyush
    Nandi, G. C.
    2018 5TH IEEE UTTAR PRADESH SECTION INTERNATIONAL CONFERENCE ON ELECTRICAL, ELECTRONICS AND COMPUTER ENGINEERING (UPCON), 2018, : 724 - 729
  • [7] Using Deep Learning Technology to Realize the Automatic Control Program of Robot Arm Based on Hand Gesture Recognition
    Chen, Shang-Liang
    Huang, Li-Wu
    INTERNATIONAL JOURNAL OF ENGINEERING AND TECHNOLOGY INNOVATION, 2021, 11 (04) : 241 - 250
  • [8] Human-Robot Interaction Based on Facial Expression Recognition Using Deep Learning
    Maeda, Yoichiro
    Sakai, Tensei
    Kamei, Katsuari
    Cooper, Eric W.
    2020 JOINT 11TH INTERNATIONAL CONFERENCE ON SOFT COMPUTING AND INTELLIGENT SYSTEMS AND 21ST INTERNATIONAL SYMPOSIUM ON ADVANCED INTELLIGENT SYSTEMS (SCIS-ISIS), 2020, : 211 - 216
  • [9] Indoor localization system using deep learning based scene recognition
    Labinghisa, Boney A.
    Lee, Dong Myung
    MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (20) : 28405 - 28429
  • [10] Human-Robot Interactive System for Warehouses using Speech, SLAM, and Deep Learning-based Barcode Recognition
    Nambiappan, Harish Ram
    Nikanfar, Sama
    Roy, Ayon
    Hussain, Joey
    Shinglot, Deep
    Acharya, Sneh
    Gans, Nicholas
    Makedon, Fillia
    17TH ACM INTERNATIONAL CONFERENCE ON PERVASIVE TECHNOLOGIES RELATED TO ASSISTIVE ENVIRONMENTS, PETRA 2024, 2024, : 38 - 44
12345