Fiber Bragg grating tactile perception system based on cross-modal transformer☆

被引:0
作者
Lyu, Chengang [1 ]
Wang, Tianle [1 ]
Zhang, Ze [1 ]
Li, Peiyuan [1 ]
Li, Lin [1 ]
Dai, Jiangqianyi [1 ]
机构
[1] Tianjin Univ, Sch Elect & Informat Engn, Tianjin 300072, Peoples R China
基金
中国国家自然科学基金;
关键词
Bionic tactile sensing; FBG sensor; Cross-modal transformer; Object recognition;
D O I
10.1016/j.optlastec.2024.111917
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
This study proposes a fiber Bragg grating (FBG) tactile sensing system utilizing a cross-modal Transformer architecture. Human tactile perception relies not only on single modalities but also on multimodal perception. Therefore, we decode the collected FBG tactile signals into dynamic vibration and static stress signals, and perform cross-modal perception to enable a robotic hand to perceive tactile properties of touched objects for precise manipulation. Experimental results demonstrate accuracy rates exceeding 87% for identifying the hardness and roughness properties of objects. Furthermore, the system occupies only 2.4 MB of storage space and achieves a recognition time of only 0.92 s per instance. Due to its lightweight and low-latency characteristics, the system holds wide application prospects in the field of tactile perception, including smart manufacturing, virtual reality, and online healthcare.
引用
收藏
页数:8
相关论文
共 31 条
[11]   Fiber Bragg grating-based fingertip tactile sensors for normal/shear forces and temperature detection [J].
Jin, Kezhen ;
Li, Zeren ;
Nan, Pengyu ;
Xin, Guoguo ;
Lim, Kok-Sing ;
Ahmad, Harith ;
Yang, Hangzhou .
SENSORS AND ACTUATORS A-PHYSICAL, 2023, 357
[12]  
Lee J, 2022, INT C CONTR AUTOMAT, P1453, DOI 10.23919/ICCAS55662.2022.10003727
[13]   Learning the human perceptions of touch force positing and object shape using a soft optical fiber tactile sensing pad [J].
Li, Lijun ;
Xu, Tianzong ;
Xue, Mengge ;
Yin, Xiucheng ;
Liu, Yinming ;
Yuan, Yibo ;
Ma, Qian .
OPTICS AND LASER TECHNOLOGY, 2024, 179
[14]   RSM-Based Data-Driven Optimized Design of a 3-D-Printed Building Block-Type FBG Tactile Sensor for Nursing Robots [J].
Li, Tianliang ;
Zhao, Zebin ;
Li, Xiong ;
Tan, Yuegang ;
Zhou, Zude .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72
[15]   A self-powered magnetoelectric tactile sensor for material recognition [J].
Liu, Gaoyu ;
Liao, Hongpeng ;
Zhao, Xuan ;
Cao, Junyi ;
Liao, Wei-Hsin .
SENSORS AND ACTUATORS A-PHYSICAL, 2024, 366
[16]   Design Optimization and Characterization of a 3-D-Printed Tactile Sensor for Tissue Palpation [J].
Lo Presti, D. ;
Zoboli, L. ;
Addabbo, A. ;
Bianchi, D. ;
Dimo, A. ;
Massaroni, C. ;
Altomare, V. ;
Grasso, A. ;
Gizzi, A. ;
Schena, E. .
IEEE SENSORS JOURNAL, 2024, 24 (08) :12366-12373
[17]   Optimization and characterization of a 3D-printed wearable strain sensor for respiration and heartbeat measurements [J].
Lo Presti, Daniela ;
Bianchi, Daniele ;
Massaroni, Carlo ;
Coricciati, Chiara ;
Rainer, Alberto ;
Silvestri, Sergio ;
Gizzi, Alessio ;
Schena, Emiliano .
MEASUREMENT, 2024, 228
[18]   Tactile recognition technology based on Multi-channel fiber optical sensing system [J].
Lyu, Chengang ;
Xiao, Yanping ;
Deng, Yi ;
Chang, Xinyi ;
Yang, Bo ;
Tian, Jiachen ;
Jin, Jie .
MEASUREMENT, 2023, 216
[19]   FBG Tactile Sensing System Based on GAF and CNN [J].
Lyu, Chengang ;
Yang, Bo ;
Chang, Xinyi ;
Tian, Jiachen ;
Deng, Yi ;
Jin, Jie .
IEEE SENSORS JOURNAL, 2022, 22 (19) :18841-18849
[20]   Three-Fingers FBG Tactile Sensing System Based on Squeeze-and-Excitation LSTM for Object Classification [J].
Lyu, Chengang ;
Yang, Bo ;
Tian, Jiachen ;
Jin, Jie ;
Ge, Chunfeng ;
Yang, Jiachen .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2022, 71