Visual Servo Control of Plant Protection Robot Based on Semantic Segmentation

被引：0
作者：
Li X. [1 ]
Fang H. [2 ,3 ]
Zhu Y. [1 ]
Du B. [1 ]
Dong H. [1 ]
机构：
[1] Faculty of Information Technology, Beijing University of Technology, Beijing
[2] School of Agricultural Engineering, Jiangsu University, Zhenjiang
[3] Key Laboratory of Modern Agricultural Equipment and Technology, Jiangsu University, Ministry of Education, Zhenjiang
来源：
Nongye Jixie Xuebao/Transactions of the Chinese Society for Agricultural Machinery | 2024年 / 55卷 / 05期
关键词：
crop line feature detection; deep learning; plant protection robot; semantic segmentation net; visual servo control;
D O I：
10.6041/j.issn.1000-1298.2024.05.002
中图分类号：
学科分类号：
摘要：
A crop line feature detection method based on semantic segmentation network was proposed to realize stable and reliable visual servo control of plant protection robot. Based on the semantic segmentation network which was termed with ESNet, pixel-wise labeling in farmland images was performed for ribbon regions detection, and least mean squares algorithm was utilized to find out all the crop line feature parameters in real time. Among the derived candidate lines features, a key route line was chosen as the valid navigation path which was responsible for subsequent robot motion control. Kalman filter was subsequently employed to smooth geometrical parameters of the previously specified key route, which effectively suppressed the fluctuation of navigation parameters caused by jolt behavior of plant protection robot generated from uneven ground and measurement noises incorporated in visual images. Afterwards, the sophisticated Ackermann steering kinematic model which was characterized by robot front-wheel steering and rear-wheel differential was introduced. A pure tracking controller was designed in Cartesian coordinate system to realize the servo motion control of plant protection robot. The field experiment conducted in real farmland scenarios verified the effectiveness of the proposed method. © 2024 Chinese Society of Agricultural Machinery. All rights reserved.
引用
收藏
页码：21 / 27and39
页数：2718
相关论文
共 18 条
  • [1] CHEN Pengfei, MA Xiao, Research status and trends of automatic detection of crop planting rows, Scientia Agricultura Sinica, 54, 13, pp. 2737-2745, (2021)
  • [2] ZHANG Man, JI Yuhan, LI Shichao, Et al., Research progress of agricultural machinery navigation technology, Transactions of the Chinese Society for Agricultural Machinery, 51, 4, pp. 1-18, (2020)
  • [3] JI Changying, ZHOU Jun, Current situation of navigation technologies for agricultural machinery, Transactions of the Chinese Society for Agricultural Machinery, 45, 9, pp. 44-54, (2014)
  • [4] AN Qiu, LI Zhichen, JI Changying, Et al., Agricultural robot vision navigation algorithm based on illumination invariant image, Transactions of the CSAE, 25, 11, pp. 208-212, (2009)
  • [5] YU Y, BAO Y, WANG J, Et al., Crop row segmentation and detection in paddy fields based on treble-classification Otsu and double-dimensional clustering method, Remote Sensing, 13, 5, (2021)
  • [6] LI Y, HONG Z, CAI D, Et al., A SVM and SLIC based detection method for paddy field boundary line, Sensors, 20, 9, (2020)
  • [7] WANG Shanshan, YU Shanshan, ZHANG Wenyi, Et al., Detection of rice seedling rows based on Hough transform of feature point neighborhood, Transactions of the Chinese Society for Agricultural Machinery, 51, 10, pp. 18-25, (2020)
  • [8] ZHANG T, XIA J, WU G, Et al., Automatic navigation path detection method for tillage machines working on high crop stubble fields based on machine vision, International Journal of Agricultural and Biological Engineering, 7, 4, pp. 29-37, (2014)
  • [9] LI Xiuzhi, PENG Xiaobin, FANG Huimin, Et al., Navigation path detection of plant protection robot based on RANSAC algorithm, Transactions of the Chinese Society for Agricultural Machinery, 51, 9, pp. 40-46, (2020)
  • [10] PHILIPP L, JENS B, ANDRES M, Et al., Fully convolutional networks with sequential information for robust crop and weed detection in precision farming, IEEE Robotics & Automation Letters, 3, 3, pp. 1943-1949, (2018)
12