Real-time tilapia fillet defect segmentation on edge device for robotic trimming

被引:0
作者
He, Yingchao [1 ]
Xu, Weidong [1 ]
Liu, Da [1 ]
Qu, Maozhen [1 ]
Fu, Jiaying [1 ]
Cheng, Fang [1 ,2 ]
机构
[1] Zhejiang Univ, Coll Biosyst Engn & Food Sci, 866 Yuhangtang Rd, Hangzhou 310058, Zhejiang, Peoples R China
[2] Minist Agr, Key Lab Site Proc Equipment Agr Prod, Hangzhou, Peoples R China
关键词
Fish processing; Robotic trimming; Computer vision; YOLOv8; Deployment; FISH;
D O I
10.1016/j.compag.2024.109337
中图分类号
S [农业科学];
学科分类号
09 ;
摘要
The implementation of robotic tilapia fillet trimming instead of manual labor is a pivotal advancement in intelligent fish processing, offering substantial superiority in operational efficiency and product quality. The study presents an improved model called TFDS-YOLOv8n for tilapia fillet defects segmentation. The model incorporates Coordinate Attention (CA) into the feature extraction layer, thereby enhancing its ability to capture characteristics at various levels of the input. Additionally, the feature fusion layer is reconstructed as Slim-Neck to reduce the number of parameters without compromising prediction accuracy. Furthermore, the bounding box loss function is modified by MPDIoU to expedite the model convergence. The proposed model was tested employing the dataset collected from the practical tilapia processing plant. Ablation experiments demonstrate that TFDS-YOLOv8n achieves a reduction of 0.29 MB in parameters and 1 Gin Floating Point Operations (FLOPs) while increasing bbox_mAP and mask_mAP by 2.8 % and 2.5 %, respectively. Eventually, the model is further accelerated by TensorRT and deployed on the edge device. Experimental results show that the quantized model possesses a faster inference speed than the untransformed model, which realizes real-time detection of tilapia fillet defects and facilitates robotization in fish processing.
引用
收藏
页数:12
相关论文
共 50 条
[21]   Semantics recalibration and detail enhancement network for real-time semantic segmentation [J].
Mi, Aizhong ;
Gao, Mingming ;
Huo, Zhanqiang ;
Qiao, Yingxu ;
Chen, Jian ;
Jia, Haiyang .
IET COMPUTER VISION, 2023, 17 (04) :461-472
[22]   A new real-time method for description and generalized segmentation of color images [J].
Kiy K.I. .
Pattern Recognition and Image Analysis, 2010, 20 (02) :169-178
[23]   Real-Time Detection and Spatial Segmentation of Difference Image Motion Changes [J].
Zhou, Kai ;
Huang, Yingping ;
Chen, Enqing ;
Yuan, Rui ;
Zhang, Zhendong .
IEEE ACCESS, 2020, 8 :144931-144944
[24]   Real-Time Instance Segmentation for Detection of Underwater Litter as a Plastic Source [J].
Corrigan, Brendan Chongzhi ;
Tay, Zhi Yung ;
Konovessis, Dimitrios .
JOURNAL OF MARINE SCIENCE AND ENGINEERING, 2023, 11 (08)
[25]   EdgeEye - An Edge Service Framework for Real-time Intelligent Video Analytics [J].
Liu, Peng ;
Qi, Bozhao ;
Banerjee, Suman .
EDGESYS'18: PROCEEDINGS OF THE FIRST ACM INTERNATIONAL WORKSHOP ON EDGE SYSTEMS, ANALYTICS AND NETWORKING, 2018, :1-6
[26]   ROAD EDGE TRACKING FOR ROBOT ROAD FOLLOWING - A REAL-TIME IMPLEMENTATION [J].
MORGAN, AD ;
DAGLESS, EL ;
MILFORD, DJ ;
THOMAS, BT .
IMAGE AND VISION COMPUTING, 1990, 8 (03) :233-240
[27]   Computer vision for real-time extrusion quality monitoring and control in robotic construction [J].
Kazemian, Ali ;
Yuan, Xiao ;
Davtalab, Omid ;
Khoshnevis, Behrokh .
AUTOMATION IN CONSTRUCTION, 2019, 101 :92-98
[28]   Experiment on Real-Time Image Processing in the Controlling of Mecanum Wheel Robotic Car [J].
Oo, Aung San ;
Naing, Min Yan ;
Nilkhamhang, Itthisek ;
Than, Thida .
2019 FIRST INTERNATIONAL SYMPOSIUM ON INSTRUMENTATION, CONTROL, ARTIFICIAL INTELLIGENCE, AND ROBOTICS (ICA-SYMP 2019), 2019, :41-44
[29]   Real-time portable system for fabric defect detection using an ARM processor [J].
Fernandez-Gallego, J. A. ;
Yanez-Puentes, J. P. ;
Ortiz-Jaramillo, B. ;
Alvarez, J. ;
Orjuela-Vargas, S. A. ;
Philips, W. .
OPTICS, PHOTONICS, AND DIGITAL TECHNOLOGIES FOR MULTIMEDIA APPLICATIONS II, 2012, 8436
[30]   A survey of real-time surface defect inspection methods based on deep learning [J].
Liu, Yi ;
Zhang, Changsheng ;
Dong, Xingjun .
ARTIFICIAL INTELLIGENCE REVIEW, 2023, 56 (10) :12131-12170