DFTNet: Dual Flow Transformer Network for Conveyor Belt Edge Detection

被引:2
|
作者
Yang, Zhifang [1 ]
Zhang, Liya [1 ]
Hao, Bonan [1 ]
Li, Biao [1 ]
Zhang, Tianxiang [2 ]
机构
[1] China Coal Res Inst, China Coal Technol Engn Grp, Beijing 100013, Peoples R China
[2] Univ Sci & Technol Beijing, Sch Automat & Elect Engn, Beijing 100083, Peoples R China
关键词
Edge detection; belt deviation; machine vision; deep learning; encoder-decoder;
D O I
10.1142/S2301385024500249
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In traditional conveyor belt edge detection methods, contact detection methods have a high cost. At the same time noncontact detection methods have low precision, and the methods based on the convolutional neural network are limited by the local operation features of the convolution operation itself, causing problems such as insufficient perception of long-distance and global information. In order to solve the above problems, a dual flow transformer network (DFTNet) integrating global and local information is proposed for belt edge detection. DFTNet could improve belt edge detection accuracy and suppress the interference of belt image noise. In this paper, the authors have merged the advantages of the traditional convolutional neural network's ability to extract local features and the transformer structure's ability to perceive global and long-distance information. Here, the fusion block is designed as a dual flow encoder-decoder structure, which could better integrate global context information and avoid the disadvantages of a transformer structure pretrained on large datasets. Besides, the structure of the fusion block is designed to be flexible and adjustable. After sufficient experiments on the conveyor belt dataset, the comparative results show that DFTNet can effectively balance accuracy and efficiency and has the best overall performance on belt edge detection tasks, outperforming full convolution methods. The processing image frame rate reaches 53.07 fps, which can meet the real-time requirements of the industry. At the same time, DFTNet can deal with belt edge detection problems in various scenarios, which gives it great practical value.
引用
收藏
页码:877 / 885
页数:9
相关论文
共 50 条
  • [1] FastBeltNet: a dual-branch light-weight network for real-time conveyor belt edge detection
    Zhao, Xing
    Zeng, Minhao
    Dong, Yanglin
    Rao, Gang
    Huang, Xianshan
    Mo, Xutao
    JOURNAL OF REAL-TIME IMAGE PROCESSING, 2024, 21 (04)
  • [2] Application of Lightweight Convolutional Neural Network for Damage Detection of Conveyor Belt
    Zhang, Mengchao
    Zhang, Yuan
    Zhou, Manshan
    Jiang, Kai
    Shi, Hao
    Yu, Yan
    Hao, Nini
    APPLIED SCIENCES-BASEL, 2021, 11 (16):
  • [3] Detection Method of Edge Position of Belt Conveyor Based on Complex Environment
    Xu, Cheng
    Zeng, Xiangjing
    Zhang, Rui
    Wang, Kai
    2021 4TH INTERNATIONAL CONFERENCE ON ROBOTICS, CONTROL AND AUTOMATION ENGINEERING (RCAE 2021), 2021, : 417 - 422
  • [4] Coal mine conveyor belt foreign object detection based on feature enhancement and Transformer
    Gao, Han
    Zhao, Peipei
    Yu, Zheng
    Xiao, Tao
    Li, Xiaoli
    Li, Liangxian
    Meitan Kexue Jishu/Coal Science and Technology (Peking), 2024, 52 (07): : 199 - 208
  • [5] Dual-field measurement system for real-time material flow on conveyor belt
    Qiao, Wei
    Lan, Yuan
    Dong, Huijie
    Xiong, Xiaoyan
    Qiao, Tiezhu
    FLOW MEASUREMENT AND INSTRUMENTATION, 2022, 83
  • [6] Deep learning-based damage detection of mining conveyor belt
    Zhang, Mengchao
    Shi, Hao
    Zhang, Yuan
    Yu, Yan
    Zhou, Manshan
    MEASUREMENT, 2021, 175
  • [7] Dead Broiler Detection and Segmentation Using Transformer-Based Dual Stream Network
    Ham, Gyu-Sung
    Oh, Kanghan
    AGRICULTURE-BASEL, 2024, 14 (11):
  • [8] DPED: Bio-inspired dual-pathway network for edge detection
    Chen, Yongliang
    Lin, Chuan
    Qiao, Yakun
    FRONTIERS IN BIOENGINEERING AND BIOTECHNOLOGY, 2022, 10
  • [9] Tear detection of conveyor belt based on machine vision
    Wang, Honglei
    Li, Jiacheng
    Wu, Taihui
    Liu, Xiaoming
    Zhang, Junsheng
    INTERNATIONAL CONFERENCE ON INTELLIGENT EQUIPMENT AND SPECIAL ROBOTS (ICIESR 2021), 2021, 12127
  • [10] Belt vision localization algorithm based on machine vision and belt conveyor deviation detection
    Wang, Jingbo
    Liu, Qing
    Dai, Mengting
    2019 34RD YOUTH ACADEMIC ANNUAL CONFERENCE OF CHINESE ASSOCIATION OF AUTOMATION (YAC), 2019, : 274 - 278