Research on 3D reconstruction of fruit tree and fruit recognition and location method based on RGB-D camera

被引：0

作者：

Mai, Chunyan ^{[1
]}

Zheng, Lihua ^{[1
]}

Sun, Hong ^{[1
]}

Yang, Wei ^{[1
]}

机构：

[1] Key Laboratory of Modern Precision Agriculture System Integration Research, Ministry of Education, China Agricultural University, Beijing

来源：

Nongye Jixie Xuebao/Transactions of the Chinese Society for Agricultural Machinery | 2015年 / 46卷

关键词：

3D reconstruction; Apple harvesting robot; Location; Recognition; RGB-D camera; Segmentation of point cloud;

D O I：

10.6041/j.issn.1000-1298.2015.S0.006

中图分类号：

学科分类号：

摘要：

In order to provide a scientific and reliable technical guidance for fruit harvesting robot in orchard, a method was proposed in this paper to reconstruct 3D image for apple tree and carry out recognition and location for each apple fruit. Firstly, the color image and depth image of the fruit trees were taken by an RGB-D camera, and the 3D reconstruction of each fruit tree was carried out by fusing its color and depth information. Then, 3D point cloud of the fruit region were segmented from tree's point cloud by applying the color threshold of R-G. Finally, the 3D shape of each fruit point cloud was extracted and its 3D spatial position information and radius were also obtained by using iteratively the RANSAC (Random sample consensus) algorithm to fit each fruit to a pre-defined apple model. The experimental results showed that the proposed method of 3D reconstruction of apple tree and recognition and location of its fruits had good real-time performance and strong robustness. In the measurement range of 0.8~2.0 m, the correct recognition rates of fruits under frontlighting and backlighting conditions were 95.5% and 88.5% respectively, and the correct recognition rate was 87.4% in the case that the sheltered area of fruit point clouds was over 50%, besides, the average position calculation error of the fruit was 8.1 mm, and the average radius calculation error was 4.5 mm. © 2015, Chinese Society for Agricultural Machinery. All right reserved.

引用

页码：35 / 40

页数：5

共 31 条

[1]

Khoshroo A., Arefi A., Khodaei J., Detection of red tomato on plants using image processing techniques, Agricultural Communications, 2, 4, pp. 9-15, (2014)

[2]

Sharma D.J., Kaur J., Robotic apple harvesting using computer vision based on shape & colour analysis and object positioning, Digital Signal Processing, 6, 7, pp. 226-233, (2014)

[3]

Molto E., Pla F., Juste F., Vision systems for the location of citrus fruit in a tree canopy, Journal of Agricultural Engineering Research, 52, pp. 101-110, (1992)

[4]

Palaniappan A., Lee W.S., Burks T.F., Color vision system for estimating citrus yield in real-time, 2004 ASAE Annual International Meeting, (2004)

[5]

Lu Q., Cai J., Zhao J., Et al., Real-time recognition of citrus on trees in natural scene, Transactions of the Chinese Society for Agricultural Machinery, 41, 2, pp. 185-188, (2010)

[6]

Wijethunga P., Samarasinghe S., Kulasiri D., Et al., Digital image analysis based automated kiwifruit counting technique, Image and Vision Computing New Zealand 23rd International Conference, (2008)

[7]

Cui Y., Su S., Wang X., Et al., Recognition and feature extraction of kiwi-fruit in natural environment based on machine vision, Transactions of the Chinese Society for Agricultural Machinery, 44, 5, pp. 247-252, (2013)

[8]

Payne A.B., Walsh K.B., Subedi P.P., Et al., Estimation of mango crop yield using image analysis segmentation method, Computers and Electronics in Agriculture, 91, pp. 57-64, (2013)

[9]

Bulanon D.M., Kataoka T., Fruit detection system and an end effector for robotic harvesting of Fuji apples, Agricultural Engineering International CIGR Journal, 12, 1, pp. 203-210, (2010)

[10]

Lak M.B., Apple fruits recognition under natural luminance using machine vision, Advance Journal of Food Science & Technology, 2, 6, pp. 325-327, (2010)

← 1 2 3 4 →