Efficient 3D object tracking approach based on convolutional neural network and Monte Carlo algorithms used for a pick and place robot

被引:3
|
作者
Zhang, Y.
Zhang, C.
Nestler, R.
Rosenberger, M.
Notni, G.
机构
来源
PHOTONICS AND EDUCATION IN MEASUREMENT SCIENCE | 2019年 / 11144卷
关键词
image processing; 3d object detection; robot vision; deep learning; pick and place robot; 3D tracking; HISTOGRAMS;
D O I
10.1117/12.2530333
中图分类号
TH7 [仪器、仪表];
学科分类号
0804 ; 080401 ; 081102 ;
摘要
Currently, Deep Learning (DL) shows us powerful capabilities for image processing. But it cannot output the exact photometric process parameters and shows non-interpretable results. Considering such limitations, this paper presents a robot vision system based on Convolutional Neural Networks (CNN) and Monte Carlo algorithms. As an example to discuss about how to apply DL in industry. In the approach, CNN is used for preprocessing and offline tasks. Then the 6-DoF object position are estimated using a particle filter approach. Experiments will show that our approach is efficient and accurate. In future it could show potential solutions for human-machine collaboration systems.
引用
收藏
页数:6
相关论文
共 50 条
  • [21] 3D Face Reconstruction Based on Convolutional Neural Network
    Li Fangmin
    Chen Ke
    Liu Xinhua
    2017 10TH INTERNATIONAL CONFERENCE ON INTELLIGENT COMPUTATION TECHNOLOGY AND AUTOMATION (ICICTA 2017), 2017, : 71 - 74
  • [22] A 3D Convolutional Neural Network Towards Real-time Amodal 3D Object Detection
    Sun, Hao
    Meng, Zehui
    Du, Xinxin
    Ang, Marcelo H., Jr.
    2018 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2018, : 8331 - 8338
  • [23] Multi-camera multi-object voxel-based Monte Carlo 3D tracking strategies
    Canton-Ferrer C.
    Casas J.R.
    Pardàs M.
    Monte E.
    EURASIP Journal on Advances in Signal Processing, 2011 (1)
  • [24] WCNN3D: Wavelet Convolutional Neural Network-Based 3D Object Detection for Autonomous Driving
    Alaba, Simegnew Yihunie
    Ball, John E.
    SENSORS, 2022, 22 (18)
  • [25] VoxNet: A 3D Convolutional Neural Network for Real-Time Object Recognition
    Maturana, Daniel
    Scherer, Sebastian
    2015 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2015, : 922 - 928
  • [26] An Improved Multi-View Convolutional Neural Network for 3D Object Retrieval
    He, Xinwei
    Bai, Song
    Chu, Jiajia
    Bai, Xiang
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 : 7917 - 7930
  • [27] Camera-based 3D object tracking and following mobile robot
    Mir-Nasiri, Nazim
    2006 IEEE CONFERENCE ON ROBOTICS, AUTOMATION AND MECHATRONICS, VOLS 1 AND 2, 2006, : 290 - 295
  • [28] New telecare approach based on 3D convolutional neural network for estimating quality of life
    Nakagawa, Satoshi
    Enomoto, Daiki
    Yonekura, Shogo
    Kanazawa, Hoshinori
    Kuniyoshi, Yasuo
    NEUROCOMPUTING, 2020, 397 : 464 - 476
  • [29] Template Update Based on 3D-Convolutional Siamese Network for Object Tracking
    Lu, Xiaofeng
    Wang, Xuan
    Wang, Zhengyang
    Hei, Xinhong
    2021 2ND ASIA CONFERENCE ON COMPUTERS AND COMMUNICATIONS (ACCC 2021), 2021, : 57 - 62
  • [30] 3D Sketch-based 3D Model Retrieval with Convolutional Neural Network
    Ye, Yuxiang
    Li, Bo
    Lu, Yijuan
    2016 23RD INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2016, : 2936 - 2941