Research on coal mine XR intelligent operation and maintenance system for complex collaborative tasks involving multiple humans and multiple robots

被引：0
|
作者：
Wang X. [1 ,2 ,3 ]
Liu S. [1 ,2 ]
Wang X. [1 ,2 ,3 ]
Xie J. [1 ,2 ,3 ]
Liu J. [1 ,2 ]
Wang X. [1 ,2 ,3 ]
机构：
[1] College of Mechanical and Vehicle Engineering, Taiyuan University of Technology, Taiyuan
[2] Shanxi Key Laboratory of Fully-Mechanized Coal Mining Equipment, Taiyuan
[3] National Key Laboratory of Intelligent Mining Equipment Technology, Taiyuan
来源：
Meitan Xuebao/Journal of the China Coal Society | 2024年 / 49卷 / 04期
关键词：
coal mine intelligence; coal mine operators; coal mine robots; digital twin; human-robot collaboration; XR intelligent operation and maintenance;
D O I：
10.13225/j.cnki.jccs.2023.1548
中图分类号：
学科分类号：
摘要：
With the development of coal mine intelligence and the application of coal mine robots, an efficient collaboration between coal mine operators and coal mine robots plays a crucial role in the execution of complex underground tasks. To optimize the complex operational relationship of multiple coal mine operators and multiple robots, based on the concept of digital twin and extensive experience in the XR field, the research is conducted on the design and key technologies of XR intelligent operation and maintenance system for complex collaborative tasks involving multiple humans and multiple robots in coal mines. Firstly, for a typical scenario of collaboration between two types of coal mine operators (i.e central control operators and field control operators) and two types of coal mine robots (i.e. detection robots and operating robots) in complex tasks, the overall system architecture is designed. The system is divided into three parts: the physical subsystem, VR operation and maintenance subsystem, and AR operation and maintenance subsystem. The content, functions, and collaborative operation relationships among these three parts are introduced. Then, an analysis of key technologies related to the VR operation and maintenance subsystem, AR operation and maintenance subsystem, and communication networking is carried out. The solutions corresponding to each key technology are discussed, and the integration and operation of the two types of coal mine operators, two types of coal mine robots, and VR/AR operation and maintenance subsystem are implemented. Finally, a laboratory environment simulating complex underground conditions is set up to create a test site, where the task points and specific tasks are defined. The feasibility and effectiveness of the system are tested and verified. The experimental results show that the coal mine XR intelligent operation and maintenance system is able to function in collaborative situations between multiple humans and multiple robots corresponding to different complex tasks. Through the collaborative operation of the VR operation and maintenance subsystem and the AR operation and maintenance subsystem, the collaborative perception, decision-making, and control between virtual space and physical space can be achieved. This allows for the iterative optimization and verification of complex tasks in a physical space from a virtual space, forming an intelligent operational mode of human-human, human-robot, and robot-robot interactive collaboration. © 2024 China Coal Society. All rights reserved.
引用
收藏
页码：2124 / 2140
页数：16
相关论文
共 35 条
  • [1] YUAN Liang, Theory and technology considerations on high-quality development of coal main energy security in China[J], Bulletin of Chinese Academy of Sciences, 38, 1, pp. 11-22, (2023)
  • [2] WANG Guofa, LIU Feng, PANG Yihui, Et al., Coal mine intellectual-ization：The core technology of high quality development[J], Journal of China Coal Society, 44, 2, pp. 349-357, (2019)
  • [3] LIU Feng, CAO Wenjun, ZHANG Jianming, Et al., Current technological innovation and development direction of the 14th Five-Year Plan period in China coal industry[J], Journal of China Coal Society, 46, 1, pp. 1-15, (2021)
  • [4] GE Shirong, HU Eryi, LI Yunwang, New progress and direction of robot technology in coal mine[J], Journal of China Coal Society, 48, 1, pp. 54-73, (2023)
  • [5] WANG Guofa, DU Yibo, Development direction of intelligent coal mine and intelligent mining technology[J], Coal Science and Technology, 47, 1, pp. 1-10, (2019)
  • [6] WANG Baicun, XUE Yuan, YAN Jianlin, Et al., Human-centered intelligent manufacturing： Overview and perspectives[J], Strategic Study of CAE, 22, 4, pp. 139-146, (2020)
  • [7] XIE Jiacheng, FANG Shukai, WANG Xuewen, Et al., Exploration and practice of the human-machine collaborative intelligent operation mode of fully mechanized coal mining face driven by humanistic intelligent manufacturing and XR+technology[J], Journal of China Coal Society, 48, 2, (2023)
  • [8] GE Shirong, ZHANG Fan, WANG Shibo, Et al., Digital twin for smart coal mining workface： Technological frame and construction[J], Journal of China Coal Society, 45, 6, pp. 1925-1936, (2020)
  • [9] ZHANG Fan, GE Shirong, Construction method and evolution mechanism of mine digital twins[J], Journal of China Coal Society, 48, 1, pp. 510-522, (2023)
  • [10] XIE Jiacheng, WANG Xuewen, YANG Zhaojian, Et al., Design and operation mode of production system of fully mechanized coal mining face based on digital twin theory[J], Computer Integrated Manufacturing Systems, 25, 6, pp. 1381-1391, (2019)
1234