Auxiliary assembly human-machine interaction method based on smart glasses

被引:2
|
作者
Xu, Kai [1 ]
Zhao, Qijie [1 ]
Kong, Yaohui [1 ]
Li, Haojie [1 ]
机构
[1] Shanghai Univ, Shanghai Key Lab Intelligent Mfg & Robot, Sch Mechatron Engn & Automat, Shanghai, Peoples R China
来源
2019 11TH INTERNATIONAL CONFERENCE ON INTELLIGENT HUMAN-MACHINE SYSTEMS AND CYBERNETICS (IHMSC 2019), VOL 2 | 2019年
关键词
smart glasses; working station identification; machine vision; operation guidance;
D O I
10.1109/IHMSC.2019.10103
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
For large and complex manufacturing industries such as aviation, high-speed rail, and ship building, some assembly processes are complex and cannot be fully automated. Manual assembly is the main requirement, which puts high demands on assembly personnel. Aiming at the problems existing in the current way of operation guidance, a method for assembly operation to guide human-machine interaction, based on the intelligent glasses, is proposed. On the basis of computer vision, the SURF( Speed Up Robust Features) features algorithm, k-means and SVM(Support Vector Machine) constructed word bag model are used in the smart glasses terminal to recognize working station, and then support the process documents query, and a method for complex operation procedures guidance is proposed.
引用
收藏
页码:33 / 36
页数:4
相关论文
共 15 条
  • [1] Redundant object detection method for civil aircraft assembly based on machine vision and smart glasses
    Zhao, Qijie
    Kong, Yaohui
    Sheng, Shaojie
    Zhu, Junjun
    MEASUREMENT SCIENCE AND TECHNOLOGY, 2022, 33 (10)
  • [2] Human-computer interaction based on machine vision of a smart assembly workbench
    Wu, Shiqing
    Wang, Zhonghou
    Shen, Bin
    Wang, Jia-Hai
    Li Dongdong
    ASSEMBLY AUTOMATION, 2020, 40 (03) : 475 - 482
  • [3] Measurement Method of Human Lower Limb Joint Range of Motion Through Human-Machine Interaction Based on Machine Vision
    Wang, Xusheng
    Liu, Guowei
    Feng, Yongfei
    Li, Wei
    Niu, Jianye
    Gan, Zhongxue
    FRONTIERS IN NEUROROBOTICS, 2021, 15
  • [4] Unobtrusive Tremor Detection and Measurement via Human-Machine Interaction
    Guettler, J.
    Shah, R.
    Georgoulas, C.
    Bock, T.
    6TH INTERNATIONAL CONFERENCE ON EMERGING UBIQUITOUS SYSTEMS AND PERVASIVE NETWORKS (EUSPN 2015)/THE 5TH INTERNATIONAL CONFERENCE ON CURRENT AND FUTURE TRENDS OF INFORMATION AND COMMUNICATION TECHNOLOGIES IN HEALTHCARE (ICTH-2015), 2015, 63 : 467 - 474
  • [5] Application of Machine Vision Technology in Intelligent Testing of Nuclear Power DCS Human-Machine Interaction
    Wu, Yao
    Li, Ming-gang
    Sun, Xiao-qi
    NEW ENERGY POWER GENERATION AUTOMATION AND INTELLIGENT TECHNOLOGY, VOL 2, 2024, 1250 : 182 - 194
  • [6] Fast and accurate obstacle detection of manipulator in complex human-machine interaction workspace
    Cui, Yuming
    Jiang, Linheng
    Liu, Songyong
    Jiang, Hongxiang
    MEASUREMENT SCIENCE AND TECHNOLOGY, 2022, 33 (08)
  • [7] Object surface roughness/texture recognition using machine vision enables for human-machine haptic interaction
    Lin, Zixuan
    Zheng, Haowei
    Lu, Yue
    Zhang, Jiaji
    Chai, Guohong
    Zuo, Guokun
    FRONTIERS IN COMPUTER SCIENCE, 2024, 6
  • [8] EMG and gaze based interaction with graphic interface of smart glasses application
    Kocejko, Tomasz
    Bujnowski, Adam
    Ruminski, Jacek
    Czuszynski, Krzysztof
    Pietrewicz, Michal
    Polinski, Artur
    2016 9TH INTERNATIONAL CONFERENCE ON HUMAN SYSTEM INTERACTIONS (HSI), 2016, : 476 - 482
  • [9] AI Methods for Personalized Suggestions on Smart Glasses Based on Human Activity Recognition
    Boucharas, Dimitrios G.
    Androutsos, Christos
    Tachos, Nikolaos S.
    Tripoliti, Evanthia E.
    Manousos, Dimitrios
    Skaramagkas, Vasileios
    Ktistakis, Emmanouil
    Marias, Kostas
    Tsiknakis, Manolis
    Fotiadis, Dimitrios I.
    2022 IEEE-EMBS INTERNATIONAL CONFERENCE ON BIOMEDICAL AND HEALTH INFORMATICS (BHI) JOINTLY ORGANISED WITH THE IEEE-EMBS INTERNATIONAL CONFERENCE ON WEARABLE AND IMPLANTABLE BODY SENSOR NETWORKS (BSN'22), 2022,
  • [10] Product Blind Area Assembly Method Based on Augmented Reality and Machine Vision
    Wang Z.
    Yan Y.
    Han D.
    Bai X.
    Zhang S.
    Xibei Gongye Daxue Xuebao/Journal of Northwestern Polytechnical University, 2019, 37 (03): : 496 - 502