Coal mine conveyor belt foreign object detection based on feature enhancement and Transformer

被引:0
|
作者
Gao, Han [1 ]
Zhao, Peipei [1 ]
Yu, Zheng [1 ]
Xiao, Tao [2 ]
Li, Xiaoli [2 ]
Li, Liangxian [3 ]
机构
[1] School of Information and Control Engineering, China University of Mining and Technology, Xuzhou
[2] Changzhou Haitu Information Technology Co., Changzhou
[3] Zhaogu No.2 Mine, Jiaozuo Coal Industry (Group) Xinxiang Energy Co., Ltd., Xinxiang
来源
Meitan Kexue Jishu/Coal Science and Technology (Peking) | 2024年 / 52卷 / 07期
关键词
conveyor belt; deep learning; foreign object detection; ghost convolution; YOLOv7-tiny;
D O I
10.12438/cst.2023-1336
中图分类号
学科分类号
摘要
Conveyor belt is one of the most important transportation equipment in underground coal mines. Anchor rod, channel steel, large gangue, and other foreign objects that are mixed with the conveyor belt during conveying operations cause the belt to tear, clog the coal drop opening, and cause other serious safety incidents. They seriously affect the efficiency of transportation and even threaten the lives of workers. Aiming at the existing conveyor belt foreign object detection algorithm’s problems such as weak characterization of slender objects and poor weak semantic feature extraction, a foreign object detection algorithm based on low-level feature enhancement with Transformer is designed, notated as FET–YOLO. Firstly, to address the problem that existing detection networks have difficulty in extracting features of elongated objects, deformable convolution is introduced to enhance the network’s adaptability to the shape characteristics of elongated foreign objects, and the MobileViT module is used to increase the differentiation between the foreign objects and the background in the image, in order to extract features that are more consistent with the diversity of the elongated foreign objects and to weaken the interference of background noise.Secondly, constructing a low-level feature enhancement module LFEM, to improve the representation of weak semantic features of foreign objects in the detection network in order to reduce the probability of wrong detection.Finally, the introduction of gsconv reduces the information loss due to changes in the size of the feature map and ensures that the network extracts features efficiently while reducing the number of model parameters. The training set and validation set are produced by using the video of conveyor belt work in an underground coal mine. The proposed algorithm is compared to three other conveyor belt detection algorithms, and the experimental results show that the proposed algorithm can better solve the problems of poor detection of elongated objects and difficulty in weak semantic feature extraction in conveyor belt foreign object target detection, with higher detection accuracy. For images with a resolution size of 640×640, the performance metrics mAP@0.5 can be up to 0.875, mAP@0.5:0.95 can be up to 0.543, and the detection speed is 75 fps. © 2024 China Coal Society. All rights reserved.
引用
收藏
页码:199 / 208
页数:9
相关论文
共 28 条
  • [1] WU Yin, Research report on the economic situation of China's coal industry in,2022–2023[J], China Coal, 49, 3, pp. 2-10, (2023)
  • [2] CHENG D Q, KOU Q Q, Et al., Lightweight network for coal belt foreign object classification with fusion of residual information[J], Journal of Coal, 47, 3, pp. 1361-1369, (2022)
  • [3] LIU Fuqiang, QIAN Jiansheng, WANG Xinhong, Et al., Automatic sorting of coal mine gangue based on image processing and recognition technology[J], Journal of Coal, 45, 5, pp. 534-537, (2000)
  • [4] CHENG J,, WANG D W,, YANG L K,, Et al., An improved video detection method for coal gangue with Gaussian mixture model[J], Journal of Central South University( Natural Science Edition), 49, 1, pp. 118-123, (2018)
  • [5] YU Le, A new method for image recognition of coal and coal gangue[J], Modern Computer( Professional Edition), 17, pp. 66-70, (2017)
  • [6] LI M, ZHU M Q, Et al., Gate valve opening detection based on improved YOLO-tiny[J], Journal of Coal, 46, S2, pp. 1180-1190, (2021)
  • [7] 25, 4, pp. 629-654, (2020)
  • [8] He K, Gkioxari G, Dollar P, Et al., Mask R-CNN, Ieee Transactions on Pattern Analysis and Machine Intelligence, 42, 2, pp. 386-397, (2020)
  • [9] REN S,, HE K,, GIRSHICK R,, Et al., Faster R–CNN:Towards Real-Time Object Detection with Region Proposal Networks[J], IEEE Trans Pattern Anal Mach Intell, 39, 6, (2017)
  • [10] LV Zhiqiang, Research on foreign body image recognition in coal mine belt transportation under complex environment, (2020)