Real-time tilapia fillet defect segmentation on edge device for robotic trimming

被引:0
作者
He, Yingchao [1 ]
Xu, Weidong [1 ]
Liu, Da [1 ]
Qu, Maozhen [1 ]
Fu, Jiaying [1 ]
Cheng, Fang [1 ,2 ]
机构
[1] Zhejiang Univ, Coll Biosyst Engn & Food Sci, 866 Yuhangtang Rd, Hangzhou 310058, Zhejiang, Peoples R China
[2] Minist Agr, Key Lab Site Proc Equipment Agr Prod, Hangzhou, Peoples R China
关键词
Fish processing; Robotic trimming; Computer vision; YOLOv8; Deployment; FISH;
D O I
10.1016/j.compag.2024.109337
中图分类号
S [农业科学];
学科分类号
09 ;
摘要
The implementation of robotic tilapia fillet trimming instead of manual labor is a pivotal advancement in intelligent fish processing, offering substantial superiority in operational efficiency and product quality. The study presents an improved model called TFDS-YOLOv8n for tilapia fillet defects segmentation. The model incorporates Coordinate Attention (CA) into the feature extraction layer, thereby enhancing its ability to capture characteristics at various levels of the input. Additionally, the feature fusion layer is reconstructed as Slim-Neck to reduce the number of parameters without compromising prediction accuracy. Furthermore, the bounding box loss function is modified by MPDIoU to expedite the model convergence. The proposed model was tested employing the dataset collected from the practical tilapia processing plant. Ablation experiments demonstrate that TFDS-YOLOv8n achieves a reduction of 0.29 MB in parameters and 1 Gin Floating Point Operations (FLOPs) while increasing bbox_mAP and mask_mAP by 2.8 % and 2.5 %, respectively. Eventually, the model is further accelerated by TensorRT and deployed on the edge device. Experimental results show that the quantized model possesses a faster inference speed than the untransformed model, which realizes real-time detection of tilapia fillet defects and facilitates robotization in fish processing.
引用
收藏
页数:12
相关论文
共 50 条
[41]   ECSNet: An Accelerated Real-Time Image Segmentation CNN Architecture for Pavement Crack Detection [J].
Zhang, Tianjie ;
Wang, Donglei ;
Lu, Yang .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2023, 24 (12) :15105-15112
[42]   Real-time semantic segmentation on FPGAs for autonomous vehicles with hls4ml [J].
Ghielmetti, Nicolo ;
Loncar, Vladimir ;
Pierini, Maurizio ;
Roed, Marcel ;
Summers, Sioni ;
Aarrestad, Thea ;
Petersson, Christoffer ;
Linander, Hampus ;
Ngadiuba, Jennifer ;
Lin, Kelvin ;
Harris, Philip .
MACHINE LEARNING-SCIENCE AND TECHNOLOGY, 2022, 3 (04)
[43]   S-Net: A Lightweight Real-Time Semantic Segmentation Network for Autonomous Driving [J].
Mazhar, Saquib ;
Atif, Nadeem ;
Bhuyan, M. K. ;
Ahamed, Shaik Rafi .
COMPUTER VISION AND IMAGE PROCESSING, CVIP 2023, PT II, 2024, 2010 :147-159
[44]   Real-time instance segmentation with polygons using an Intersection-over-Union loss [J].
Jodogne-del Litto, Katia ;
Bilodeau, Guillaume-Alexandre .
2023 20TH CONFERENCE ON ROBOTS AND VISION, CRV, 2023, :153-160
[45]   Vision-Based Real-Time Obstacle Segmentation Algorithm for Autonomous Surface Vehicle [J].
Kim, Hanguen ;
Koo, Jungmo ;
Kim, Donghoon ;
Park, Byeolteo ;
Jo, Yonggil ;
Myung, Hyun ;
Lee, Donghwa .
IEEE ACCESS, 2019, 7 :179420-179428
[46]   Real-Time Camera Operator Segmentation with YOLOv8 in Football Video Broadcasts [J].
Postupaiev, Serhii ;
Damasevicius, Robertas ;
Maskeliunas, Rytis .
AI, 2024, 5 (02) :842-872
[47]   Real-time pavement surface crack detection based on lightweight semantic segmentation model [J].
Yu, Huayang ;
Deng, Yihao ;
Guo, Feng .
TRANSPORTATION GEOTECHNICS, 2024, 48
[48]   Implementation of Real-Time Skin Segmentation Based on K-Means Clustering Method [J].
De, Souranil ;
Rakshit, Soumik ;
Biswas, Abhik ;
Saha, Srinjoy ;
Datta, Sujoy .
COMPUTATIONAL VISION AND BIO-INSPIRED COMPUTING, 2020, 1108 :964-973
[49]   An intelligent retrievable object-tracking system with real-time edge inference capability [J].
Li, Yujie ;
Wang, Yifu ;
Ma, Zihang ;
Wang, Xinghe ;
Tan, Benying ;
Ding, Shuxue .
IET IMAGE PROCESSING, 2025, 19 (01)
[50]   Intelligent Real-Time IoT Traffic Steering in 5G Edge Networks [J].
Math, Sa ;
Tam, Prohim ;
Kim, Seokhoon .
CMC-COMPUTERS MATERIALS & CONTINUA, 2021, 67 (03) :3433-3450