A low-cost UAV framework towards ornamental plant detection and counting in the wild

被引:43
作者
Bayraktar, Ertugrul [1 ,2 ]
Basarkan, Muhammed Enes [3 ]
Celebi, Numan [3 ]
机构
[1] Ist Italiano Tecnol, Visual Geometry & Modelling VGM, Genoa, Italy
[2] Duzce Univ, Fac Engn, Dept Mechatron Engn, TR-81620 Duzce, Turkey
[3] Sakarya Univ, Dept Informat Syst Engn, TR-54050 Sakarya, Turkey
关键词
Object counting; Plant detection; Remote sensing; Aerial imagery; Geometrical relations; SPATIAL-RESOLUTION; CLASSIFICATION; IMAGES;
D O I
10.1016/j.isprsjprs.2020.06.012
中图分类号
P9 [自然地理学];
学科分类号
0705 ; 070501 ;
摘要
Object detection still keeps its role as one of the fundamental challenges within the computer vision territory. In particular, achieving satisfying results concerning object detection from outdoor images occupies a considerable space. In this study, in addition to comparing handcrafted feature detector/descriptor performance with deep learning methods over ornamental plant images at the outdoor, we propose a framework to improve the detection of these plants. Firstly, we take query images in the RGB format from the onboard UAV camera. Secondly, our model classifies the scene as a planting or an urban area. Thirdly, if the images are from planting area, thirdly, we filter the field according to the color and acquire only the green parts. Lastly, we feed the object detector model with the filtered area and obtain the category and localization of the plants as a result. In parallel, we also estimate the number of interested plants using the geometrical relations and predefined average plant size, then we verify the outputs of the object detector with this results. The conducted experiments show that deep learning based object detection methods overtake conventional feature detector/descriptor techniques in terms of accuracy, recall, precision, and sensitivity rates. The field classifier model, VGGNet, achieves a 98.17% accuracy for this task, whilst YoloV3 achieves 91.6% accuracy with 0.12 IOU for object detection as the best method. The proposed framework also improves the overall performance of these algorithms by 1.27% for accuracy and 0.023 for IOU. By specifying the limits thoroughly and developing task-dependent approaches, we reveal the great potential of our framework plant detection and counting in the wild consisting of basic image preprocessing techniques, geometrical operations, and deep neural network.
引用
收藏
页码:1 / 11
页数:11
相关论文
共 55 条
  • [1] Deep Learning Approach for Car Detection in UAV Imagery
    Ammour, Nassim
    Alhichri, Haikel
    Bazi, Yakoub
    Benjdira, Bilel
    Alajlan, Naif
    Zuair, Mansour
    [J]. REMOTE SENSING, 2017, 9 (04)
  • [2] Speeded-Up Robust Features (SURF)
    Bay, Herbert
    Ess, Andreas
    Tuytelaars, Tinne
    Van Gool, Luc
    [J]. COMPUTER VISION AND IMAGE UNDERSTANDING, 2008, 110 (03) : 346 - 359
  • [3] Analysis of feature detector and descriptor combinations with a localization experiment for various performance metrics
    Bayraktar, Ertugrul
    Boyraz, Pinar
    [J]. TURKISH JOURNAL OF ELECTRICAL ENGINEERING AND COMPUTER SCIENCES, 2017, 25 (03) : 2444 - 2454
  • [4] Thermal and Narrowband Multispectral Remote Sensing for Vegetation Monitoring From an Unmanned Aerial Vehicle
    Berni, Jose A. J.
    Zarco-Tejada, Pablo J.
    Suarez, Lola
    Fereres, Elias
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2009, 47 (03): : 722 - 738
  • [5] Object based image analysis for remote sensing
    Blaschke, T.
    [J]. ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2010, 65 (01) : 2 - 16
  • [6] FACE RECOGNITION - FEATURES VERSUS TEMPLATES
    BRUNELLI, R
    POGGIO, T
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1993, 15 (10) : 1042 - 1052
  • [7] Evaluating Multispectral Images and Vegetation Indices for Precision Farming Applications from UAV Images
    Candiago, Sebastian
    Remondino, Fabio
    De Giglio, Michaela
    Dubbini, Marco
    Gattelli, Mario
    [J]. REMOTE SENSING, 2015, 7 (04) : 4026 - 4047
  • [8] Examining the effect of spatial resolution and texture window size on classification accuracy: an urban environment case
    Chen, D
    Stow, DA
    Gong, P
    [J]. INTERNATIONAL JOURNAL OF REMOTE SENSING, 2004, 25 (11) : 2177 - 2192
  • [9] Unmanned aerial systems for photogrammetry and remote sensing: A review
    Colomina, I.
    Molina, P.
    [J]. ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2014, 92 : 79 - 97
  • [10] Precise Real-Time Detection of Nonforested Areas With UAVs
    Cruz, Henry O.
    Eckert, Martina
    Meneses, Juan M.
    Martinez, Jose Fernan
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2017, 55 (02): : 632 - 644