Object View Prediction with Aleatoric Uncertainty for Robotic Grasping

被引:0
作者
Schwan, Constanze [1 ]
Schenck, Wolfram [1 ]
机构
[1] Bielefeld Univ Appl Sci & Arts, Fac Engn & Math, Bielefeld, Germany
来源
2023 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN | 2023年
关键词
convolutional neural network; aleatoric uncertainty; object view prediction; robotic grasping; weighted intersection over union; SEGMENTATION;
D O I
10.1109/IJCNN54540.2023.10191465
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In vision-based robotic grasping the prediction of grasps is made on an RGB-D image of the scene from a pregrasp position. Due to perspective occlusions the information about the object to be grasped is incomplete. Therefore the reliable prediction of a successful grasp is difficult. In this study we investigate a convolutional neural network that can predict several depth views of an object from a single depth image and camera movements. We show how the heteroscedastic aleatoric uncertainty can be used to predict the uncertainty of the generated object views. As the classical Negative-Log-Likelihood loss function for the aleatoric uncertainty does not converge to a meaningful object view prediction, we investigate the modified ss-Negative-Log-Likelihood loss function and the Moment Matching loss. For assessing the predicted uncertainty we introduce a new measure, the uncertainty weighted intersection over union value.
引用
收藏
页数:8
相关论文
共 28 条
[1]  
Avigal Y., 2020, ARXIV200908618CS
[2]  
Bohg Jeannette, 2011, IEEE International Conference on Robotics and Automation, P686
[3]  
Chang A X, 2015, COMPUTER SCI, V1512, P3
[4]  
Cho Y.-J., 2022, ARXIV210709858CS
[5]   Vision-based robotic grasping from object localization, object pose estimation to grasp estimation for parallel grippers: a review [J].
Du, Guoguang ;
Wang, Kai ;
Lian, Shiguo ;
Zhao, Kaiyong .
ARTIFICIAL INTELLIGENCE REVIEW, 2021, 54 (03) :1677-1734
[6]  
Duerr O., 2020, Probabilistic deep learning: With python, keras and tensorflow probability
[7]   You Get What You Focus on: A Weighting Factor for IoU-based Regression Loss [J].
Gu, Xinyu ;
Gao, Chao ;
Lu, Zheng ;
Cui, Tianxiang .
2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
[8]  
Gualtieri M, 2021, IEEE ROBOT AUTOM LET, V6, P1753, DOI [10.1109/LRA.2021.3060669, 10.1109/lra.2021.3060669]
[9]  
Han KZ, 2019, CHIN CONT DECIS CONF, P1142, DOI [10.1109/ccdc.2019.8833184, 10.1109/CCDC.2019.8833184]
[10]  
Jaskowski M., 2018, ARXIV180205992CSSTAT