YOLO-Based 3D Perception for UVMS Grasping

被引:2
作者
Chen, Yanhu [1 ]
Zhao, Fuqiang [1 ]
Ling, Yucheng [1 ]
Zhang, Suohang [1 ]
机构
[1] Zhejiang Univ, State Key Lab Fluid Power & Mechatron Syst, Hangzhou 310027, Peoples R China
基金
中国国家自然科学基金;
关键词
underwater object detection; deep learning; underwater binocular ranging; marine organism grasping;
D O I
10.3390/jmse12071110
中图分类号
U6 [水路运输]; P75 [海洋工程];
学科分类号
0814 ; 081505 ; 0824 ; 082401 ;
摘要
This study develops a YOLO (You Only Look Once)-based 3D perception algorithm for UVMS (Underwater Vehicle-Manipulator Systems) for precise object detection and localization, crucial for enhanced grasping tasks. The object detection algorithm, YOLOv5s-CS, integrates an enhanced YOLOv5s model with C3SE attention and SPPFCSPC feature fusion, optimized for precise detection and two-dimensional localization in underwater environments with sparse features. Distance measurement is further improved by refining the SGBM (Semi-Global Block Matching) algorithm with Census transform and subpixel interpolation. Ablation studies highlight the YOLOv5s-CS model's enhanced performance, with a 3.5% increase in mAP and a 6.4% rise in F1 score over the base YOLOv5s, and a 2.1% mAP improvement with 15% faster execution than YOLOv8s. Implemented on a UVMS, the algorithm successfully conducted pool grasping experiments, proving its applicability for autonomous underwater robotics.
引用
收藏
页数:20
相关论文
共 27 条
[1]  
Antonelli G., 2014, Springer Tracts in Advanced Robotics), V2, P23
[2]   Grasping Marine Products With Hybrid-Driven Underwater Vehicle-Manipulator System [J].
Cai, Mingxue ;
Wang, Yu ;
Wang, Shuo ;
Wang, Rui ;
Ren, Yong ;
Tan, Min .
IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2020, 17 (03) :1443-1454
[3]  
Hirschmüller H, 2008, IEEE T PATTERN ANAL, V30, P328, DOI [10.1109/TPAMI.2007.1166, 10.1109/TPAMl.2007.1166]
[4]  
Hu J, 2018, PROC CVPR IEEE, P7132, DOI [10.1109/TPAMI.2019.2913372, 10.1109/CVPR.2018.00745]
[5]   A review on visual servoing for underwater vehicle manipulation systems automatic control and case study [J].
Huang, Hai ;
Bian, Xinyu ;
Cai, Fengchun ;
Li, Jiyong ;
Jiang, Tao ;
Zhang, Zhenkun ;
Sun, Chaoyu .
OCEAN ENGINEERING, 2022, 260
[6]   Object perception in underwater environments: a survey on sensors and sensing methodologies [J].
Huy, Dinh Quang ;
Sadjoli, Nicholas ;
Azam, Abu Bakr ;
Elhadidi, Basman ;
Cai, Yiyu ;
Seet, Gerald .
OCEAN ENGINEERING, 2023, 267
[7]   Binocular Vision-Based Non-Singular Fast Terminal Control for the UVMS Small Target Grasp [J].
Jiang, Tao ;
Sun, Yize ;
Huang, Hai ;
Qin, Hongde ;
Chen, Xi ;
Li, Lingyu ;
Zhang, Zongyu ;
Han, Xinyue .
JOURNAL OF MARINE SCIENCE AND ENGINEERING, 2023, 11 (10)
[8]   A NSGA-II-Based Calibration Algorithm for Underwater Binocular Vision Measurement System [J].
Kong, Shihan ;
Fang, Xi ;
Chen, Xingyu ;
Wu, Zhengxing ;
Yu, Junzhi .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2020, 69 (03) :794-803
[9]   Underwater Target Detection Algorithm Based on Improved YOLOv5 [J].
Lei, Fei ;
Tang, Feifei ;
Li, Shuhan .
JOURNAL OF MARINE SCIENCE AND ENGINEERING, 2022, 10 (03)
[10]   Toward in situ zooplankton detection with a densely connected YOLOV3 model [J].
Li, Yan ;
Guo, Jiahong ;
Guo, Xiaomin ;
Zhao, Jinsong ;
Yang, Yi ;
Hu, Zhiqiang ;
Jin, Wenming ;
Tian, Yu .
APPLIED OCEAN RESEARCH, 2021, 114