Cross Position Aggregation Network for Few-Shot Strip Steel Surface Defect Segmentation

被引:49
作者
Feng, Hu [1 ,2 ]
Song, Kechen [1 ,2 ]
Cui, Wenqi [1 ,2 ]
Zhang, Yiming [1 ,2 ]
Yan, Yunhui [1 ,2 ]
机构
[1] Northeastern Univ, Natl Frontiers Sci Ctr Ind Intelligence & Syst Opt, Sch Mech Engn & Automation, Minist Educ, Shenyang 110819, Liaoning, Peoples R China
[2] Northeastern Univ, Key Lab Data Analyt & Optimizat Smart Ind, Minist Educ, Shenyang 110819, Liaoning, Peoples R China
基金
中国国家自然科学基金;
关键词
Steel; Feature extraction; Strips; Semantic segmentation; Aggregates; Training; Surface morphology; Cross-position aggregation network (CPANet); few-shot learning; few-shot semantic segmentation (FSS); strip steel surface defect ((SD)-D-3) segmentation; CLASSIFICATION;
D O I
10.1109/TIM.2023.3246519
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Strip steel surface defect (S3D) segmentation is a crucial method to inspect the surface quality of strip steel in the producing-and-manufacturing. However, existing S3D semantic segmentation methods depend on quite a few labeled defective samples for training, and generalization to novel defect categories that have not yet been trained is challenging. Additionally, some defect categories are incredibly sparse in the industrial production processes. Motivated by the above problems, this article proposed a simple but effective few-shot segmentation method named cross position aggregation network (CPANet), which intends to learn a network that can segment untrained S3D categories with only a few labeled defective samples. Using a cross-position proxy (CPP) module, our CPANet can effectively aggregate long-range relationships of discrete defects, and support auxiliary (SA) can further improve the feature aggregation capability of CPP. Moreover, CPANet introduces a space squeeze attention (SSA) module to aggregate multiscale context information of defect features and suppresses disadvantageous interference from background information. In addition, a novel S3D few-shot semantic segmentation (FSS) dataset FSSD-12 is proposed to evaluate our CPANet. Through extensive comparison experiments and ablation experiments, we explicitly evaluate that our CPANet with the ResNet-50 backbone achieves state-of-theart performance on dataset FSSD-12. Our dataset and code are available at (https://github.com/VDT-2048/CPANet).
引用
收藏
页数:10
相关论文
共 54 条
[1]  
[Anonymous], 2015, P C NEUR INF PROC SY
[2]  
[Anonymous], 2010, International journal of computer vision, DOI DOI 10.1007/s11263-009-0275-4
[3]   Triplet-Graph Reasoning Network for Few-Shot Metal Generic Surface Defect Segmentation [J].
Bao, Yanqi ;
Song, Kechen ;
Liu, Jie ;
Wang, Yanyan ;
Yan, Yunhui ;
Yu, Han ;
Li, Xingjie .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2021, 70
[4]   X-SDD: A New Benchmark for Hot Rolled Steel Strip Surface Defects Detection [J].
Feng, Xinglong ;
Gao, Xianwen ;
Luo, Ling .
SYMMETRY-BASEL, 2021, 13 (04)
[5]   Dual Attention Network for Scene Segmentation [J].
Fu, Jun ;
Liu, Jing ;
Tian, Haijie ;
Li, Yong ;
Bao, Yongjun ;
Fang, Zhiwei ;
Lu, Hanqing .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :3141-3149
[6]   Automatic Defect Detection on Hot-Rolled Flat Steel Products [J].
Ghorai, Santanu ;
Mukherjee, Anirban ;
Gangadaran, M. ;
Dutta, Pranab K. .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2013, 62 (03) :612-621
[7]  
Han J., 2022, P INT JOINT C ART IN
[8]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[9]   An End-to-End Steel Surface Defect Detection Approach via Fusing Multiple Hierarchical Features [J].
He, Yu ;
Song, Kechen ;
Meng, Qinggang ;
Yan, Yunhui .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2020, 69 (04) :1493-1504
[10]  
Hu J., 2018, P IEEE C COMPUTER VI, P7132, DOI [DOI 10.1109/TPAMI.2019.2913372, 10.1109/TPAMI.2019.2913372]