Development of a Method for Detecting Cutting Points of Wilted Leaves Using 2D Image Keypoints and 3D Point Cloud

被引:0
|
作者
Department of Mechanical Design and Robot Engineering, Seoul National University of Science and Technology, Korea, Republic of [1 ]
不详 [2 ]
机构
来源
J. Inst. Control Rob. Syst. | 2024年 / 11卷 / 1237-1244期
关键词
Machine vision;
D O I
10.5302/J.ICROS.2024.24.0206
中图分类号
学科分类号
摘要
In agriculture, removing withered leaves is crucial for maintaining crop quality and preventing pests and diseases. This paper proposes a method for estimating the pose of wilted leaves and removing wilted leaves. While estimating precisely 3D location and pose information is essential for this task, most of previous methods for pose estimation have difficulty in processing time due to the complexity of feature extraction from 3D point cloud. The proposed method utilizes the YOLOv8 keypoint detection model to obtain image information, and YOLOv7 instance segmentation to isolate the region of interest. We calculate the 3D coordinates of the cutting point and the 3D rotation of the wilted leaf by applying RANSAC plane fitting and projection on 3D point cloud, simplifying the information required for the task. The method was validated using five types of model plant pots, achieving an average processing time of 98.584 ms and an accuracy of 3.83 mm. Additionally, the method recorded a 78% success rate in the removal of withered leaves. © 2024, Institute of Control, Robotics and Systems. All rights reserved.
引用
收藏
页码:1237 / 1244
相关论文
共 50 条
  • [41] 3D IMAGE SEGMENTATION SUPPORTED BY A POINT CLOUD
    Kosa, Balazs
    Mikula, Karol
    Uba, Markjoe Olunna
    Weberling, Antonia
    Christodoulou, Neophytos
    Zernicka-Goetz, Magdalena
    DISCRETE AND CONTINUOUS DYNAMICAL SYSTEMS-SERIES S, 2021, 14 (03): : 971 - 985
  • [42] 2D/3D image registration using regression learning
    Chou, Chen-Rui
    Frederick, Brandon
    Mageras, Gig
    Chang, Sha
    Pizer, Stephen
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2013, 117 (09) : 1095 - 1106
  • [43] Hyperspectral image classification using 3D 2D CNN
    Diakite, Alou
    Gui, Jiangsheng
    Fu, Xiaping
    IET IMAGE PROCESSING, 2021, 15 (05) : 1083 - 1092
  • [44] 3D Point Cloud Generation from 2D Depth Camera Images Using Successive Triangulation
    Pal, Bishwajit
    Khaiyum, Samitha
    Kumaraswamy, Y. S.
    2017 INTERNATIONAL CONFERENCE ON INNOVATIVE MECHANISMS FOR INDUSTRY APPLICATIONS (ICIMIA), 2017, : 129 - 133
  • [45] 2D to 3D Image Transformation Using Wavelet Technique
    Agarwal, Mohit
    Sharma, Manish
    Sehgal, Shruti
    Shantanu
    2014 INTERNATIONAL CONFERENCE ON MEDICAL IMAGING, M-HEALTH & EMERGING COMMUNICATION SYSTEMS (MEDCOM), 2015, : 137 - 141
  • [46] Development of a robust algorithm for transformation of a 3D object point onto a 2D image point for linear pushbroom imagery
    Kim, T
    Shin, D
    Lee, YR
    PHOTOGRAMMETRIC ENGINEERING AND REMOTE SENSING, 2001, 67 (04): : 449 - 452
  • [47] 3D Hand Shape and Pose Estimation based on 2D Hand Keypoints
    Drosakis, Drosakis
    Argyros, Antonis
    PROCEEDINGS OF THE 16TH ACM INTERNATIONAL CONFERENCE ON PERVASIVE TECHNOLOGIES RELATED TO ASSISTIVE ENVIRONMENTS, PETRA 2023, 2023, : 148 - 153
  • [48] Relating image points of 3D coplanar point grids with 2D-labeling
    Zhang, XF
    Cheng, DC
    Burkhardt, H
    PROCEEDINGS OF THE FIFTH JOINT CONFERENCE ON INFORMATION SCIENCES, VOLS 1 AND 2, 2000, : A91 - A94
  • [49] Head Pose Estimation through Keypoints Matching between Reconstructed 3D Face Model and 2D Image
    Liu, Leyuan
    Ke, Zeran
    Huo, Jiao
    Chen, Jingying
    SENSORS, 2021, 21 (05) : 1 - 24
  • [50] A Fast and Robust Rotation Search and Point Cloud Registration Method for 2D Stitching and 3D Object Localization
    Sun, Lei
    Deng, Zhongliang
    APPLIED SCIENCES-BASEL, 2021, 11 (20):