Efficient 3D object tracking approach based on convolutional neural network and Monte Carlo algorithms used for a pick and place robot

被引:3
作者
Zhang, Y.
Zhang, C.
Nestler, R.
Rosenberger, M.
Notni, G.
机构
来源
PHOTONICS AND EDUCATION IN MEASUREMENT SCIENCE | 2019年 / 11144卷
关键词
image processing; 3d object detection; robot vision; deep learning; pick and place robot; 3D tracking; HISTOGRAMS;
D O I
10.1117/12.2530333
中图分类号
TH7 [仪器、仪表];
学科分类号
0804 ; 080401 ; 081102 ;
摘要
Currently, Deep Learning (DL) shows us powerful capabilities for image processing. But it cannot output the exact photometric process parameters and shows non-interpretable results. Considering such limitations, this paper presents a robot vision system based on Convolutional Neural Networks (CNN) and Monte Carlo algorithms. As an example to discuss about how to apply DL in industry. In the approach, CNN is used for preprocessing and offline tasks. Then the 6-DoF object position are estimated using a particle filter approach. Experiments will show that our approach is efficient and accurate. In future it could show potential solutions for human-machine collaboration systems.
引用
收藏
页数:6
相关论文
共 50 条
  • [41] Automated segmentation of vertebral cortex with 3D U-Net-based deep convolutional neural network
    Li, Yang
    Yao, Qianqian
    Yu, Haitao
    Xie, Xiaofeng
    Shi, Zeren
    Li, Shanshan
    Qiu, Hui
    Li, Changqin
    Qin, Jian
    FRONTIERS IN BIOENGINEERING AND BIOTECHNOLOGY, 2022, 10
  • [42] V-3DResNets: a 3D convolutional neural network based on residual network variants and slice grouping for pulmonary nodule detection
    Prithvika, P. C. Sarah
    Anbarasi, L. Jani
    MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (31) : 76505 - 76528
  • [43] An efficient multi-path 3D convolutional neural network for false-positive reduction of pulmonary nodule detection
    Yuan, Haiying
    Fan, Zhongwei
    Wu, Yanrui
    Cheng, Junpeng
    INTERNATIONAL JOURNAL OF COMPUTER ASSISTED RADIOLOGY AND SURGERY, 2021, 16 (12) : 2269 - 2277
  • [44] AMSASeg: An Attention-Based Multi-Scale Atrous Convolutional Neural Network for Real-Time Object Segmentation From 3D Point Cloud
    Kim, Moogab
    Ilyas, Naveed
    Kim, Kiseon
    IEEE ACCESS, 2021, 9 : 70789 - 70796
  • [45] Multi-viewport based 3D convolutional neural network for 360-degree video quality assessment
    Guo, Jiefeng
    Huang, Lianfen
    Chien, Wei-Che
    MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (12) : 16813 - 16831
  • [46] Multi-viewport based 3D convolutional neural network for 360-degree video quality assessment
    Jiefeng Guo
    Lianfen Huang
    Wei-Che Chien
    Multimedia Tools and Applications, 2022, 81 : 16813 - 16831
  • [47] A 3D Fluorescence Classification and Component Prediction Method Based on VGG Convolutional Neural Network and PARAFAC Analysis Method
    Ruan, Kun
    Zhao, Shun
    Jiang, Xueqin
    Li, Yixuan
    Fei, Jianbo
    Ou, Dinghua
    Tang, Qiang
    Lu, Zhiwei
    Liu, Tao
    Xia, Jianguo
    APPLIED SCIENCES-BASEL, 2022, 12 (10):
  • [48] Saliency-based 3D convolutional neural network for categorising common focal liver lesions on multisequence MRI
    Wang, Shu-Hui
    Han, Xin-Jun
    Du, Jing
    Wang, Zhen-Chang
    Yuan, Chunwang
    Chen, Yinan
    Zhu, Yajing
    Dou, Xin
    Xu, Xiao-Wei
    Xu, Hui
    Yang, Zheng-Han
    INSIGHTS INTO IMAGING, 2021, 12 (01)
  • [49] 3D light field display with improved visual resolution based on pre-processing convolutional neural network
    Yu Xun-bo
    Li Han-yu
    Gao Xin
    Sang Xin-zhu
    Yan Bin-bin
    Su Xi-wen
    Wen Xu-dong
    Xu Bin
    Wang Yue-di
    CHINESE JOURNAL OF LIQUID CRYSTALS AND DISPLAYS, 2022, 37 (05) : 549 - 554
  • [50] High-Density Surface EMG-Based Gesture Recognition Using a 3D Convolutional Neural Network
    Chen, Jiangcheng
    Bi, Sheng
    Zhang, George
    Cao, Guangzhong
    SENSORS, 2020, 20 (04)