AMD-Net: lightweight component defect detection network with attention-guided adaptive compressor and multi-kernel grouped convolution

被引:0
作者
Bian, Enyuan [1 ]
Yin, Mingfeng [1 ]
Gao, Qi [2 ]
Wu, Xiang [3 ]
Zhang, Lanchun [1 ]
Bei, Shaoyi [1 ]
机构
[1] Jiangsu Univ Technol, Sch Automobile & Traff Engn, Changzhou, Peoples R China
[2] Zhejiang Univ, Coll Ocean, Zhoushan, Peoples R China
[3] Nanjing Univ Sci & Technol, Sch Automat, Nanjing, Peoples R China
基金
中国国家自然科学基金;
关键词
defect detection; lightweight models; adaptive spatial attention; dynamic shared convolution head; multi-kernel grouped convolution;
D O I
10.1088/1361-6501/adcc45
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
In modern industrial fields, the quality of the components is crucial for system performance. The current defect detection methods are computationally demanding and require a large number of parameters. A novel lightweight defect detection method is proposed, named AMD-Net, which consists of three innovative modules: attention-guided adaptive compressor (AGAC), multi-kernel grouped convolution (MGC) and dynamic shared convolution head (DSCH). AGAC utilizes adaptive weight downsampling and spatial attention mechanisms to effectively preserve key features while reducing parameter counts, MGC merges multiscale kernels with grouped convolutions to enhance the detection of multiscale defects, DSCH incorporates a dynamic scale adjustment mechanism and shared convolution layers, reducing parameters and boosting computational efficiency. The model size was reduced to 65% of its original, only 4.1 MB. To improve accuracy, knowledge distillation was employed for the lightweight structure, and the mean average precision (mAP) improved by 1.9% over the original model, reaching 91 %.
引用
收藏
页数:13
相关论文
共 43 条
[1]   Autonomous Structural Visual Inspection Using Region-Based Deep Learning for Detecting Multiple Damage Types [J].
Cha, Young-Jin ;
Choi, Wooram ;
Suh, Gahyun ;
Mahmoudkhani, Sadegh ;
Buyukozturk, Oral .
COMPUTER-AIDED CIVIL AND INFRASTRUCTURE ENGINEERING, 2018, 33 (09) :731-747
[2]   A Hybrid Deep Learning Based Framework for Component Defect Detection of Moving Trains [J].
Chen, Cen ;
Li, Kenli ;
Cheng Zhongyao ;
Piccialli, Francesco ;
Hoi, Steven C. H. ;
Zeng, Zeng .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (04) :3268-3280
[3]   Automatic Defect Detection of Fasteners on the Catenary Support Device Using Deep Convolutional Neural Network [J].
Chen, Junwen ;
Liu, Zhigang ;
Wang, Hongrui ;
Nunez, Alfredo ;
Han, Zhiwei .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2018, 67 (02) :257-269
[4]  
[陈珺娴 Chen Junxian], 2020, [高分子通报, Polymer Bulletin], P1
[5]   Semi-Supervised Image Deraining Using Knowledge Distillation [J].
Cui, Xin ;
Wang, Cong ;
Ren, Dongwei ;
Chen, Yunjin ;
Zhu, Pengfei .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (12) :8327-8341
[6]   Deformable Convolutional Networks [J].
Dai, Jifeng ;
Qi, Haozhi ;
Xiong, Yuwen ;
Li, Yi ;
Zhang, Guodong ;
Hu, Han ;
Wei, Yichen .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :764-773
[7]   Lightweight Multiscale Convolutional Networks With Adaptive Pruning for Intelligent Fault Diagnosis of Train Bogie Bearings in Edge Computing Scenarios [J].
Ding, Ao ;
Qin, Yong ;
Wang, Biao ;
Jia, Limin ;
Cheng, Xiaoqing .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72
[8]   Dual-Level Knowledge Distillation via Knowledge Alignment and Correlation [J].
Ding, Fei ;
Yang, Yin ;
Hu, Hongxin ;
Krovi, Venkat ;
Luo, Feng .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (02) :2425-2435
[9]   LEFE-Net: A Lightweight Efficient Feature Extraction Network With Strong Robustness for Bearing Fault Diagnosis [J].
Fang, Hairui ;
Deng, Jin ;
Zhao, Bo ;
Shi, Yan ;
Zhou, Jianye ;
Shao, Siyu .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2021, 70
[10]   EdgeKE: An On-Demand Deep Learning IoT System for Cognitive Big Data on Industrial Edge Devices [J].
Fang, Weiwei ;
Xue, Feng ;
Ding, Yi ;
Xiong, Naixue ;
Leung, Victor C. M. .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2021, 17 (09) :6144-6152