A low-cost UAV framework towards ornamental plant detection and counting in the wild

被引:50
作者
Bayraktar, Ertugrul [1 ,2 ]
Basarkan, Muhammed Enes [3 ]
Celebi, Numan [3 ]
机构
[1] Ist Italiano Tecnol, Visual Geometry & Modelling VGM, Genoa, Italy
[2] Duzce Univ, Fac Engn, Dept Mechatron Engn, TR-81620 Duzce, Turkey
[3] Sakarya Univ, Dept Informat Syst Engn, TR-54050 Sakarya, Turkey
关键词
Object counting; Plant detection; Remote sensing; Aerial imagery; Geometrical relations; SPATIAL-RESOLUTION; CLASSIFICATION; IMAGES;
D O I
10.1016/j.isprsjprs.2020.06.012
中图分类号
P9 [自然地理学];
学科分类号
0705 ; 070501 ;
摘要
Object detection still keeps its role as one of the fundamental challenges within the computer vision territory. In particular, achieving satisfying results concerning object detection from outdoor images occupies a considerable space. In this study, in addition to comparing handcrafted feature detector/descriptor performance with deep learning methods over ornamental plant images at the outdoor, we propose a framework to improve the detection of these plants. Firstly, we take query images in the RGB format from the onboard UAV camera. Secondly, our model classifies the scene as a planting or an urban area. Thirdly, if the images are from planting area, thirdly, we filter the field according to the color and acquire only the green parts. Lastly, we feed the object detector model with the filtered area and obtain the category and localization of the plants as a result. In parallel, we also estimate the number of interested plants using the geometrical relations and predefined average plant size, then we verify the outputs of the object detector with this results. The conducted experiments show that deep learning based object detection methods overtake conventional feature detector/descriptor techniques in terms of accuracy, recall, precision, and sensitivity rates. The field classifier model, VGGNet, achieves a 98.17% accuracy for this task, whilst YoloV3 achieves 91.6% accuracy with 0.12 IOU for object detection as the best method. The proposed framework also improves the overall performance of these algorithms by 1.27% for accuracy and 0.023 for IOU. By specifying the limits thoroughly and developing task-dependent approaches, we reveal the great potential of our framework plant detection and counting in the wild consisting of basic image preprocessing techniques, geometrical operations, and deep neural network.
引用
收藏
页码:1 / 11
页数:11
相关论文
共 55 条
[11]  
Deng J, 2009, PROC CVPR IEEE, P248, DOI 10.1109/CVPRW.2009.5206848
[12]  
Everingham M, 2007, International journal of computer vision, DOI DOI 10.1007/s11263-009-0275-4
[13]   Automatic Tobacco Plant Detection in UAV Images via Deep Neural Networks [J].
Fan, Zhun ;
Lu, Jiewei ;
Gong, Maoguo ;
Xie, Honghui ;
Goodman, Erik D. .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2018, 11 (03) :876-887
[14]   Digital Counts of Maize Plants by Unmanned Aerial Vehicles (UAVs) [J].
Gnaedinger, Friederike ;
Schmidhalter, Urs .
REMOTE SENSING, 2017, 9 (06)
[15]   Phenotyping Conservation Agriculture Management Effects on Ground and Aerial Remote Sensing Assessments of Maize Hybrids Performance in Zimbabwe [J].
Gracia-Romero, Adrian ;
Vergara-Diaz, Omar ;
Thierfelder, Christian ;
Cairns, Jill E. ;
Kefauver, Shawn C. ;
Araus, Jose L. .
REMOTE SENSING, 2018, 10 (02)
[16]   Effects of spatial resolution on slope and aspect derivation for regional-scale analysis [J].
Grohmann, Carlos H. .
COMPUTERS & GEOSCIENCES, 2015, 77 :111-117
[17]   Characterizing and Counting Roofless Buildings in Very High Resolution Optical Images [J].
Gueguen, Lionel ;
Pesaresi, Martino ;
Gerhardinger, Andrea ;
Soille, Pierre .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2012, 9 (01) :114-118
[18]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[19]   Flower classification using deep convolutional neural networks [J].
Hiary, Hazem ;
Saadeh, Heba ;
Saadeh, Maha ;
Yaqub, Mohammad .
IET COMPUTER VISION, 2018, 12 (06) :855-862
[20]   Agricultural remote sensing big data: Management and applications [J].
Huang, Yanbo ;
Chen Zhong-xin ;
Yu Tao ;
Huang Xiang-zhi ;
Gu Xing-fa .
JOURNAL OF INTEGRATIVE AGRICULTURE, 2018, 17 (09) :1915-1931