Dynamic Vision Sensor Based Defect Detection for the Surface of Aluminum Disk

被引:0
作者
Ma, Ju-Po [1 ,2 ]
Chen, Zhou-Yi [1 ]
Wu, Jin-Jian [1 ,2 ]
机构
[1] School of Artificial Intelligence, Xidian University, Xi'an
[2] Pazhou Lab (Huangpu), Guangzhou
来源
Zidonghua Xuebao/Acta Automatica Sinica | 2024年 / 50卷 / 12期
关键词
Defect detection; dynamic vision sensor (DVS); event camera; highly reflective surface; irregular feature extraction; temporal fusion;
D O I
10.16383/j.aas.c240307
中图分类号
学科分类号
摘要
Current visual defect detection technologies usually rely on conventional charge-coupled device (CCD) or complementary metal-oxide-semiconductor (CMOS) cameras for defect imaging and the development of backend detection algorithms. However, these technologies encounter challenges such as slow imaging speed, limited dynamic range, and significant background interference, which hinder the rapid detection of minor defects on highly reflective product surfaces. To address these challenges, we innovatively propose a new defect detection mode based on dynamic vision sensor (DVS) to achieve efficient defect detection on the highly reflective surfaces of aluminum disks. DVS is a novel bio-inspired visual sensor with advantages such as fast imaging speed, high dynamic range, and excellent ability to capture moving objects. First, we conduct DVS imaging experiments for minor defects on the highly reflective surfaces of aluminum disk and analyze the characteristics and advantages of DVS on defect imaging. Then, we establish the first event-based defect detection dataset (EDD-10k) based on DVS, including three common defect types: Scratch, point and stain. Finally, to address the issues such as varying defect shapes, sparse textures, and noise interference, we propose a temporal irregular feature aggregation framework for event-based defect detection (TIFF-EDD), and realize the effective detection of defect targets. © 2024 Science Press. All rights reserved.
引用
收藏
页码:2407 / 2419
页数:12
相关论文
共 50 条
[1]  
Jin Xia-Ting, Wang Yao-Nan, Zhang Hui, Liu Li, Zhong Hang, He Zhen-Dong, DeepRail: Automatic visual detection system for railway surface defect using Bayesian CNN and attention network, Acta Automatica Sinica, 45, 12, pp. 2312-2327, (2019)
[2]  
Tao Xian, Hou Wei, Xu De, A survey of surface defect detection methods based on deep learning, Acta Automatica Sinica, 47, 5, pp. 1017-1034, (2021)
[3]  
Chen Y Q, Pan J W, Lei J Y, Zeng D Y, Wu Z Z, Chen C S., EEE-Net: Efficient edge enhanced network for surface defect detection of glass, IEEE Transactions on Instrumentation and Measurement, 72, (2023)
[4]  
Jiang W B, Liu M, Peng Y N, Wu L H, Wang Y N., HDCB-Net: A neural network with the hybrid dilated convolution for pixel-level crack detection on concrete bridges, IEEE Transactions on Industrial Informatics, 17, 8, pp. 5485-5494, (2021)
[5]  
Zheng Y J, Zheng L X, Yu Z F, Shi B X, Tian Y H, Huang T J., High-speed image reconstruction through short-term plasticity for spiking cameras, Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 6354-6363, (2021)
[6]  
Xu X Y, Sun D Q, Pan J S, Zhang Y J, Pfister H, Yang M H., Learning to super-resolve blurry face and text images, Proceedings of the IEEE International Conference on Computer Vision (ICCV), pp. 251-260, (2017)
[7]  
Li Jia-Ning, Tian Yong-Hong, Recent advances in neuromorphic vision sensors: A survey, Chinese Journal of Computers, 44, 6, pp. 1258-1286, (2021)
[8]  
Pan L Y, Hartley R, Scheerlinck C, Liu M M, Yu X, Dai Y C., High frame rate video reconstruction based on an event camera, IEEE Transactions on Pattern Analysis and Machine Intelligence, 44, 5, pp. 2519-2533, (2022)
[9]  
Han J, Yang Y X, Duan P Q, Zhou C, Ma L, Xu C, Et al., Hybrid high dynamic range imaging fusing neuromorphic and conventional images, IEEE Transactions on Pattern Analysis and Machine Intelligence, 45, 7, pp. 8553-8565, (2023)
[10]  
Hu Y H, Liu S C, Delbruck T., V2e: From video frames to realistic DVS events, Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 1312-1321, (2021)