Coal-Rock Image Recognition Method for Complex and Harsh Environment in Coal Mine Using Deep Learning Models

被引:13
作者
Sun, Chuanmeng [1 ,2 ]
Li, Xinyu [1 ,2 ]
Chen, Jiaxin [1 ,2 ]
Wu, Zhibo [1 ,2 ]
Li, Yong [3 ]
机构
[1] North Univ China, State Key Lab Dynam Measurement Technol, Taiyuan 030051, Peoples R China
[2] North Univ China, Sch Elect & Control Engn, Taiyuan 030051, Peoples R China
[3] Chongqing Univ, State Key Lab Coal Mine Disaster Dynam & Control, Chongqing 400044, Peoples R China
关键词
Feature extraction; Rocks; Convolution; Coal; Semantics; Interference; Image segmentation; Mining industry; Intelligent systems; Coal mining; Semantic segmentation; Lighting control; Intelligent mining; automatic recognition of coal rock; semantic segmentation; low-illuminance image segmentation;
D O I
10.1109/ACCESS.2023.3300243
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The unfavorable factors of underground coal such as dark light, uneven illumination, band shadowing greatly make it difficult to recognize the coal rock at the mining workface accurately. To solve this problem, this paper proposes the fuse attention mechanism's coal rock full-scale network (FAM-CRFSN) model. The deep extraction of coal rock semantic features is achieved by a multi-channel residual attention mechanism and a full-scale connection structure. Meanwhile, the balance between "deep" stacking and error back propagation is achieved by structures such as dilated convolution and Res2Block. Besides, a multi-dimensional loss function consisting of the cross-entropy loss, intersection over union, and multiscale structure similarity loss with pixel-level, area-level, and image-level expressions is established. Finally, the performance of the FAM-CRFSN network is tested with RGB coal rock images collected from an underground coal mining workface and superimposed with different proportions of gaussian noise and salt & pepper noise. The experimental results show that the FAM-CRFSN model can segment the coal rock regions accurately; at a noise intensity of 0.09, it achieves an MIOU of 85.77% and an MPA of 92.12%. Also, it achieves better accuracy and generalization performance than the mainstream semantic segmentation models. This study provides an important theoretical basis for promotes the unmanned and intelligent mining workface.
引用
收藏
页码:80794 / 80805
页数:12
相关论文
共 39 条
[1]  
[Anonymous], 2015, SEGNET DEEP CONVOLUT
[2]   Influence of Insufficient Dataset Augmentation on IoU and Detection Threshold in CNN Training for Object Detection on Aerial Images [J].
Bozko, Arkadiusz ;
Ambroziak, Leszek .
SENSORS, 2022, 22 (23)
[3]  
Cao S., 2015, CHIN J ROCK MECH ENG, V34, P3074, DOI [10.13722/j.cnki.jrme.2013.1490, DOI 10.13722/J.CNKI.JRME.2013.1490]
[4]   DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs [J].
Chen, Liang-Chieh ;
Papandreou, George ;
Kokkinos, Iasonas ;
Murphy, Kevin ;
Yuille, Alan L. .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (04) :834-848
[5]  
Fu D., 2022, J PHYS C SER, V2189
[6]  
[高峰 Gao Feng], 2021, [煤炭学报, Journal of China Coal Society], V46, P4088
[7]  
[郜亚松 Gao Yasong], 2021, [煤炭科学技术, Coal Science and Technology], V49, P202
[8]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[9]  
Hu J, 2018, PROC CVPR IEEE, P7132, DOI [10.1109/TPAMI.2019.2913372, 10.1109/CVPR.2018.00745]
[10]  
Hua T., 2019, Min. Process. Equip, V47, P4