Human-Following Strategy for Orchard Mobile Robot Based on the KCF-YOLO Algorithm

被引:1
作者
Huang, Zhihao [1 ]
Ou, Chuhong [1 ]
Guo, Zhipeng [1 ,2 ]
Ye, Lei [1 ]
Li, Jin [1 ]
机构
[1] Shaoguan Univ, Sch Intelligent Engn, Shaoguan 512000, Peoples R China
[2] South China Agr Univ, Coll Engn, Guangzhou 510642, Peoples R China
关键词
orchard scene; mobile robot; KCF-YOLO; human-following; visual tracking; GRAPE CLUSTERS;
D O I
10.3390/horticulturae10040348
中图分类号
S6 [园艺];
学科分类号
0902 ;
摘要
Autonomous mobile robots play a vital role in the mechanized production of orchards, where human-following is a crucial collaborative function. In unstructured orchard environments, obstacles often obscure the path, and personnel may overlap, leading to significant disruptions to human-following. This paper introduces the KCF-YOLO fusion visual tracking method to ensure stable tracking in interference environments. The YOLO algorithm provides the main framework, and the KCF algorithm intervenes in assistant tracking. A three-dimensional binocular-vision reconstruction method was used to acquire personnel positions, achieving stabilized visual tracking in disturbed environments. The robot was guided by fitting the personnel's trajectory using an unscented Kalman filter algorithm. The experimental results show that, with 30 trials in multi-person scenarios, the average tracking success rate is 96.66%, with an average frame rate of 8 FPS. Additionally, the mobile robot is capable of maintaining a stable following speed with the target individuals. Across three human-following experiments, the horizontal offset Error Y does not exceed 1.03 m. The proposed KCF-YOLO tracking method significantly bolsters the stability and robustness of the mobile robot for human-following in intricate orchard scenarios, offering an effective solution for tracking tasks.
引用
收藏
页数:24
相关论文
共 34 条
[1]   Deep-Learning-Based Indoor Human Following of Mobile Robot Using Color Feature [J].
Algabri, Redhwan ;
Choi, Mun-Taek .
SENSORS, 2020, 20 (09)
[2]  
Bolme DS, 2010, PROC CVPR IEEE, P2544, DOI 10.1109/CVPR.2010.5539960
[3]   Human detection based on deep learning YOLO-v2 for real-time UAV applications [J].
Boudjit, Kamel ;
Ramzan, Naeem .
JOURNAL OF EXPERIMENTAL & THEORETICAL ARTIFICIAL INTELLIGENCE, 2022, 34 (03) :527-544
[4]   Intelligent Multi-Robot System for Collaborative Object Transportation Tasks in Rough Terrains [J].
Choi, Daegyun ;
Kim, Donghoon .
ELECTRONICS, 2021, 10 (12)
[5]   Human Following for Outdoor Mobile Robots Based on Point-Cloud's Appearance Model [J].
Gong Linxi ;
Cai Yunfei .
CHINESE JOURNAL OF ELECTRONICS, 2021, 30 (06) :1087-1095
[6]   Convolutional Neural Network Based Tracking for Human Following Mobile Robot with LQG Based Control System [J].
Gupta, Sudip C. ;
Majumdar, Jharna .
PROCEEDINGS OF THE THIRD INTERNATIONAL CONFERENCE ON ADVANCED INFORMATICS FOR COMPUTING RESEARCH (ICAICR '19), 2019,
[7]   Human-Following of Mobile Robots Based on Object Tracking and Depth Vision [J].
Han, Dongyu ;
Peng, Yonggang .
2020 IEEE 3RD INTERNATIONAL CONFERENCE ON MECHATRONICS, ROBOTICS AND AUTOMATION (ICMRA 2020), 2020, :105-109
[8]   High-Speed Tracking with Kernelized Correlation Filters [J].
Henriques, Joao F. ;
Caseiro, Rui ;
Martins, Pedro ;
Batista, Jorge .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2015, 37 (03) :583-596
[9]   Flexible co-manipulation and transportation with mobile multi-robot system [J].
Hichri, Bassem ;
Adouane, Lounis ;
Fauroux, Jean-Christophe ;
Mezouar, Youcef ;
Doroftei, Ioan .
ASSEMBLY AUTOMATION, 2019, 39 (03) :422-431
[10]  
Kapgate Sachin, 2022, 2022 1st International Conference on the Paradigm Shifts in Communication, Embedded Systems, Machine Learning and Signal Processing (PCEMS)., P119, DOI 10.1109/PCEMS55161.2022.9807846