GelStereo Palm: A Novel Curved Visuotactile Sensor for 3-D Geometry Sensing

被引:16
作者
Hu, Jingyi [1 ,2 ]
Cui, Shaowei [2 ]
Wang, Shuo [2 ,3 ,4 ]
Zhang, Chaofan [2 ,3 ]
Wang, Rui [2 ]
Chen, Lipeng [5 ]
Li, Yuhao [6 ]
机构
[1] Univ Chinese Acad Sci, Sch Future Technol, Beijing 100049, Peoples R China
[2] Chinese Acad Sci, Inst Automat, State Key Lab Multimodal Artificial Intelligence, Beijing 100190, Peoples R China
[3] Univ Chinese Acad Sci, Sch Artificial Intelligence, Beijing 100049, Peoples R China
[4] Chinese Acad Sci, Ctr Excellence Brain Sci & Intelligence Technol, Shanghai 200031, Peoples R China
[5] Tencent Robot X Lab, Shenzhen 100190, Peoples R China
[6] Beijing Univ Posts & Telecommun, Minist Educ, Key Lab Universal Wireless Commun, Beijing 100876, Peoples R China
基金
中国国家自然科学基金;
关键词
3-D reconstruction; tactile sensor; tactile sensing;
D O I
10.1109/TII.2023.3241685
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Recently, visuotactile sensors have shown promising potential in robotics due to their high-resolution sensing ability. Unfortunately, the majority of available visuotactile sensors are limited to flat shapes, which severely limits their application possibilities. In this article, we propose a novel curved visuotactile sensor, the GelStereo Palm, which senses the 3-D contact geometry on a curved surface using a binocular vision system. Meanwhile, to solve the light refraction problem in the binocular stereo vision system under a curved medium, a refractive stereo ray tracing model for GelStereo Palm is presented. Moreover, a 3-D tactile point cloud sensing pipeline is introduced to reconstruct the 3-D contact geometry in real-time. Finally, extensive experiments are conducted to verify the accuracy and robustness of the 3-D contact geometry sensing of our GelStereo Palm sensor.
引用
收藏
页码:10853 / 10863
页数:11
相关论文
共 29 条
[11]  
Kunz C, 2008, OCEANS-IEEE, P1097
[12]   Tactile sensing: New directions, new challenges [J].
Lee, MH .
INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH, 2000, 19 (07) :636-643
[13]   Soft Biomimetic Optical Tactile Sensing With the TacTip: A Review [J].
Lepora, Nathan F. .
IEEE SENSORS JOURNAL, 2021, 21 (19) :21131-21143
[14]  
Lin X, 2020, IEEE INT CONF ROBOT, P603, DOI [10.1109/ICRA40945.2020.9197050, 10.1109/icra40945.2020.9197050]
[15]   Robotic tactile perception of object properties: A review [J].
Luo, Shan ;
Bimbo, Joao ;
Dahiya, Ravinder ;
Liu, Hongbin .
MECHATRONICS, 2017, 48 :54-67
[16]  
Romero B, 2020, IEEE INT CONF ROBOT, P4796, DOI [10.1109/icra40945.2020.9196909, 10.1109/ICRA40945.2020.9196909]
[17]   Finger-Shaped GelForce: Sensor for Measuring Surface Traction Fields for Robotic Hand [J].
Sato, Katsunari ;
Kamiyama, Kazuto ;
Kawakami, Naoki ;
Tachi, Susumu .
IEEE TRANSACTIONS ON HAPTICS, 2010, 3 (01) :37-47
[18]   Rapid manufacturing of color-based hemispherical soft tactile fingertips [J].
Scharff, Rob B. N. ;
Boonstra, Dirk-Jan ;
Willemet, Laurence ;
Lin, Xi ;
Wiertlewski, Michael .
2022 IEEE 5TH INTERNATIONAL CONFERENCE ON SOFT ROBOTICS (ROBOSOFT), 2022, :896-902
[19]   Refractive geometry for underwater domes [J].
She, Mengkun ;
Nakath, David ;
Song, Yifan ;
Koeser, Kevin .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2022, 183 :525-540
[20]   Tactile Image Sensors Employing Camera: A Review [J].
Shimonomura, Kazuhiro .
SENSORS, 2019, 19 (18)