Construction of a Multi-Modal Knowledge Graph for Railway Equipment Operation and Maintenance Based on Building Information Model Data-Driven Approach

被引：0
作者：
Lin H. [1 ,2 ]
Hu N. [1 ]
He Q. [3 ]
Zhao Z. [1 ]
Bai W. [1 ]
机构：
[1] School of Automation and Electrical Engineering, Lanzhou Jiaotong University, Lanzhou
[2] Key Laboratory of Railway Industry of Building Information Model Engineering and Intelligence for Electric Power，Traction Power Supply，Communication and Signaling, Lanzhou Jiaotong University, Lanzhou
[3] School of Information, University of Technology of Belfort-Montbéliard, Belfort
来源：
Tongji Daxue Xuebao/Journal of Tongji University | 2024年 / 52卷 / 02期
关键词：
building information model (BIM); knowledge graph; multi-modal; operation and maintenance; railway signal equipment;
D O I：
10.11908/j.issn.0253-374x.23362
中图分类号：
学科分类号：
摘要：
Railway signal equipment is essential for ensuring traffic safety and improving transportation efficiency. Strengthening the intelligence operation and maintenance of signal equipment is essential to mitigate the risks associated with railway operations. Currently，the intelligence operation and maintenance platform based on building information model（BIM）in China is unable to accurately depict the behavior and mutual feedback mechanism of each device，thus relying on experiential knowledge for inference. To address this issue，initially，the knowledge graph was constructed using the text related to the operation and maintenance of railway equipment； Subsequently， a convolutional neural networks-clique group graph convolutional neural networks（CNN-cgGCN）model was developed to process BIM image modal data and annotate the information of 20 specific railway signal equipment part drawings. The experimental results show that the accuracy of the model reaches 95.38 %，and the harmonic mean F1 of precision and recall reaches 95.58 %；Finally，BIM image information is integrated into the visual knowledge graph of operation and maintenance text. This multi-modal knowledge graph is then visualized using the Neo4j graph database，so as to accurately map the mechanism of mutual feedback between signal equipment，and offer online services and guidance to on-site railway operation and maintenance personnel，facilitating safety management and operational decision-making. © 2024 Science Press. All rights reserved.
引用
收藏
页码：166 / 173
页数：7
相关论文
共 20 条
  • [1] YE Yuling, Wengqing LI, ZHANG Jun, Research on the complex characteristics and propagation dynamics of high speed railway networks［J］, Journal of Tongji University（Natural Science）, 47, 5, (2019)
  • [2] Zili HAN, Zhanguo MA, GU Mu, Et al., Research on key technologies of intelligent operation and maintenance of heavy haul railway line equipment ［J］, Railway Engineering, 62, 8, (2022)
  • [3] ZHU Qing, ZHANG Liguo, DING Yulin, Et al., From real 3D modeling to digital twin modeling［J］, Journal of Surveying and Mapping, 51, 6, (2022)
  • [4] XIAO N, Et al., Research on the construction and implementation of power grid fault handling knowledge graphs［J］, Energy Reports, 9, (2023)
  • [5] WU Chuang, ZHANG Liang, TANG Xilang, Et al., Construction and application of fault knowledge graph for aviation engine lubrication system ［J/OL］, Journal of Beijing University of Aeronautics and Astronautics, pp. 1-14
  • [6] AYOUB H, Et al., BERT based clinical knowledge extraction for biomedical knowledge graph construction and analysis［J］, Computer Methods and Programs in Biomedicine Update, 1, (2021)
  • [7] Financial fraud detection using the related-party transaction knowledge graph［J］, Procedia Computer Science, 199, (2022)
  • [8] LIN Haixiang, BAI Wansheng, LU Renjie, Et al., Entity recognition of high-speed railway turnout fault information based on BMBC model ［J］, Journal of Railway Science and Engineering, 20, 4, (2023)
  • [9] YANG S., A text mining-based approach for understanding Chinese railway incidents caused by electromagnetic interference ［J］, Engineering Applications of Artificial Intelligence, 117, (2023)
  • [10] XUE Lian, YAO Xinwen, ZHENG Qiming, Et al., Research on the construction method of fault knowledge graph of CTCS on-board equipment ［J］, Journal of Railway Science and Engineering, 20, 1, (2023)
12