TPMN: Texture Prior-Aware Multi-Level Feature Fusion Network for Corrugated Cardboard Parcels Defect Detection

被引:0
作者
He, Xing [1 ]
Fan, Haoxiang [2 ]
Du, Cuifeng [3 ]
Zhu, Xingyu [4 ]
Zhou, Yuyu [5 ,6 ]
Chen, Renzhang [7 ]
Li, Zhefu [8 ]
Zheng, Guihua [7 ]
Zhong, Yuansheng [9 ]
Liu, Changjiang [9 ]
Yang, Jiandan [7 ]
Guan, Quanlong [5 ,6 ,10 ]
机构
[1] Jinan Univ, Coll Informat Sci & Technol, Jinan, Peoples R China
[2] Sun Yat Sen Univ, Guangzhou, Guangdong, Peoples R China
[3] Cete Potevio Sci Technol Co Ltd, Guangzhou, Guangdong, Peoples R China
[4] Off Sci R&D, Guangzhou, Guangdong, Peoples R China
[5] Jinan Univ, Guangdong Inst Smart Educ, Guangzhou, Guangdong, Peoples R China
[6] Guangdong Macao Adv Intelligent Comp Joint Lab, Guangzhou, Guangdong, Peoples R China
[7] Jinan Univ, Modern Educ Technol Ctr, Zhuhai Campus, Guangzhou, Guangdong, Peoples R China
[8] Jinan Univ, Network & Educ Technol Ctr, Guangzhou, Guangdong, Peoples R China
[9] Guangdong Testing Inst Product Qual Supervis, Key Lab Safety Intelligent Robots State Market Re, Guangzhou, Guangdong, Peoples R China
[10] Guangdong Key Lab Data Secur & Privacy Preserving, Guangzhou, Guangdong, Peoples R China
关键词
logistics; surface defect detection; multi-level feature fusion; prior attention; corrugated cardboard boxes; INSPECTION;
D O I
10.14569/IJACSA.2024.0150284
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Surface defect detection is the task of identifying and localizing defects on the surface of an object, which is a widely applied task in various industries. In the logistics industry, logistics companies need to monitor the condition of goods for potential defects throughout the entire logistics process for effective logistics quality control. However, effective defect detection methods are still lacking for courier packages using corrugated cardboard boxes, which rely on judging whether deformation and leakage have occurred by examining areas on their surface with abundant texture. Specifically, the defect rate and supporting structure of the packages are influenced by temperature and humidity, and the openings and bends of defects are inconsistent. This results in defective packages having rich and non-uniform texture features. Moreover, convolutional neural networks struggle to effectively extract low-level semantic texture features of defects and perceive multi-level image features of packages. Considering the above challenges, we propose a novel texture prior-aware multi-level feature fusion network (TPMN). We first introduce prior knowledge and attention mechanisms to enable the neural network to focus on extracting low-level texture features from the image in the early stages. We also design a multi-level feature fusion method to integrate features from different levels, avoiding the gradual loss of low-level semantic information in CNN and enabling comprehensive perception of multi-level image features. To support further research, we contribute the cardboard-boxes-dataset, comprising 1210 images of packages. Experiments on this dataset showcase the superior performance of TPMN, even in few-shot learning scenarios, demonstrating its effectiveness in surface defect detection within the logistics and supply chain domains.
引用
收藏
页码:834 / 843
页数:10
相关论文
共 35 条
  • [1] Effects of the environmental conditions on the mechanical behaviour of the corrugated cardboard
    Allaoui, S.
    Aboura, Z.
    Benzeggagh, M. L.
    [J]. COMPOSITES SCIENCE AND TECHNOLOGY, 2009, 69 (01) : 104 - 110
  • [2] SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation
    Badrinarayanan, Vijay
    Kendall, Alex
    Cipolla, Roberto
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (12) : 2481 - 2495
  • [3] An Optical Surface Inspection and Automatic Classification Technique Using the Rotated Wavelet Transform
    Borwankar, Raunak
    Ludwig, Reinhold
    [J]. IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2018, 67 (03) : 690 - 697
  • [4] Improved faster R-CNN for fabric defect detection based on Gabor filter with Genetic Algorithm optimization
    Chen, Mengqi
    Yu, Lingjie
    Zhi, Chao
    Sun, Runjun
    Zhu, Shuangwu
    Gao, Zhongyuan
    Ke, Zhenxia
    Zhu, Mengqiu
    Zhang, Yuming
    [J]. COMPUTERS IN INDUSTRY, 2022, 134
  • [5] Chen Z., ICASSP 2024
  • [6] Chen Z., 2024, 27 INT C COMP SUPP C
  • [7] Chen Z., 2023, 20 EAI INT C MOBIQUI
  • [8] Chen Z., 2023, 2023 11 INT C INF SY
  • [9] Deep learning with multi-scale feature fusion in remote sensing for automatic oceanic eddy detection
    Du, Yanling
    Song, Wei
    He, Qi
    Huang, Dongmei
    Liotta, Antonio
    Su, Chen
    [J]. INFORMATION FUSION, 2019, 49 : 89 - 99
  • [10] Tactile-Based Fabric Defect Detection Using Convolutional Neural Network With Attention Mechanism
    Fang, Bin
    Long, Xingming
    Sun, Fuchun
    Liu, Huaping
    Zhang, Shixin
    Fang, Cheng
    [J]. IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2022, 71