GelStereo Palm: A Novel Curved Visuotactile Sensor for 3-D Geometry Sensing

被引:16
作者
Hu, Jingyi [1 ,2 ]
Cui, Shaowei [2 ]
Wang, Shuo [2 ,3 ,4 ]
Zhang, Chaofan [2 ,3 ]
Wang, Rui [2 ]
Chen, Lipeng [5 ]
Li, Yuhao [6 ]
机构
[1] Univ Chinese Acad Sci, Sch Future Technol, Beijing 100049, Peoples R China
[2] Chinese Acad Sci, Inst Automat, State Key Lab Multimodal Artificial Intelligence, Beijing 100190, Peoples R China
[3] Univ Chinese Acad Sci, Sch Artificial Intelligence, Beijing 100049, Peoples R China
[4] Chinese Acad Sci, Ctr Excellence Brain Sci & Intelligence Technol, Shanghai 200031, Peoples R China
[5] Tencent Robot X Lab, Shenzhen 100190, Peoples R China
[6] Beijing Univ Posts & Telecommun, Minist Educ, Key Lab Universal Wireless Commun, Beijing 100876, Peoples R China
基金
中国国家自然科学基金;
关键词
3-D reconstruction; tactile sensor; tactile sensing;
D O I
10.1109/TII.2023.3241685
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Recently, visuotactile sensors have shown promising potential in robotics due to their high-resolution sensing ability. Unfortunately, the majority of available visuotactile sensors are limited to flat shapes, which severely limits their application possibilities. In this article, we propose a novel curved visuotactile sensor, the GelStereo Palm, which senses the 3-D contact geometry on a curved surface using a binocular vision system. Meanwhile, to solve the light refraction problem in the binocular stereo vision system under a curved medium, a refractive stereo ray tracing model for GelStereo Palm is presented. Moreover, a 3-D tactile point cloud sensing pipeline is introduced to reconstruct the 3-D contact geometry in real-time. Finally, extensive experiments are conducted to verify the accuracy and robustness of the 3-D contact geometry sensing of our GelStereo Palm sensor.
引用
收藏
页码:10853 / 10863
页数:11
相关论文
共 29 条
[1]   A Deep Learning Framework for Tactile Recognition of Known as Well as Novel Objects [J].
Abderrahmane, Zineb ;
Ganesh, Gowrishankar ;
Crosnier, Andre ;
Cherubini, Andrea .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2020, 16 (01) :423-432
[2]  
Alspach A, 2019, 2019 2ND IEEE INTERNATIONAL CONFERENCE ON SOFT ROBOTICS (ROBOSOFT 2019), P597, DOI [10.1109/robosoft.2019.8722713, 10.1109/ROBOSOFT.2019.8722713]
[3]   In-Hand Object Localization Using a Novel High-Resolution Visuotactile Sensor [J].
Cui, Shaowei ;
Wang, Rui ;
Hu, Jingyi ;
Wei, Junhang ;
Wang, Shuo ;
Lou, Zheng .
IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2022, 69 (06) :6015-6025
[4]   DenseTact: Optical Tactile Sensor for Dense Shape Reconstruction [J].
Do, Won Kyung ;
Kennedy, Monroe, III .
2022 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, ICRA 2022, 2022, :6188-6194
[5]   In-hand manipulation of a circular dynamic object by soft fingertips without angle measurement [J].
Garcia-Rodriguez, R. ;
Parra-Vega, V. .
SCIENCE CHINA-INFORMATION SCIENCES, 2021, 64 (05)
[6]   Automatic generation and detection of highly reliable fiducial markers under occlusion [J].
Garrido-Jurado, S. ;
Munoz-Salinas, R. ;
Madrid-Cuevas, F. J. ;
Marin-Jimenez, M. J. .
PATTERN RECOGNITION, 2014, 47 (06) :2280-2292
[7]   GelTip: A Finger-shaped Optical Tactile Sensor for Robotic Manipulation [J].
Gomes, Daniel Fernandes ;
Lin, Zhonglin ;
Luo, Shan .
2020 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2020, :9903-9909
[8]  
Hecht E., 2012, Optics
[9]   Vision-Based Tactile Sensor Mechanism for the Estimation of Contact Position and Force Distribution Using Deep Learning [J].
Kakani, Vijay ;
Cui, Xuenan ;
Ma, Mingjie ;
Kim, Hakil .
SENSORS, 2021, 21 (05) :1-28
[10]  
Kandel E. R., 2000, Principles of neural science, V4