Deep Learning with Unsupervised Data Labeling for Weed Detection in Line Crops in UAV Images

被引:228
作者
Bah, M. Dian [1 ]
Hafiane, Adel [2 ]
Canals, Raphael [1 ]
机构
[1] Univ Orleans, PRISME, EA 4229, F-45072 Orleans, France
[2] INSA Ctr Val Loire, PRISME, EA 4229, F-18020 Bourges, France
关键词
weed detection; deep learning; unmanned aerial vehicle; image processing; precision agriculture; crop line detection; SUPPORT VECTOR MACHINE; TEXTURE ANALYSIS; CROP/WEED DISCRIMINATION; CLASSIFICATION; SEGMENTATION; AGRICULTURE; FEATURES;
D O I
10.3390/rs10111690
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
In recent years, weeds have been responsible for most agricultural yield losses. To deal with this threat, farmers resort to spraying the fields uniformly with herbicides. This method not only requires huge quantities of herbicides but impacts the environment and human health. One way to reduce the cost and environmental impact is to allocate the right doses of herbicide to the right place and at the right time (precision agriculture). Nowadays, unmanned aerial vehicles (UAVs) are becoming an interesting acquisition system for weed localization and management due to their ability to obtain images of the entire agricultural field with a very high spatial resolution and at a low cost. However, despite significant advances in UAV acquisition systems, the automatic detection of weeds remains a challenging problem because of their strong similarity to the crops. Recently, a deep learning approach has shown impressive results in different complex classification problems. However, this approach needs a certain amount of training data, and creating large agricultural datasets with pixel-level annotations by an expert is an extremely time-consuming task. In this paper, we propose a novel fully automatic learning method using convolutional neuronal networks (CNNs) with an unsupervised training dataset collection for weed detection from UAV images. The proposed method comprises three main phases. First, we automatically detect the crop rows and use them to identify the inter-row weeds. In the second phase, inter-row weeds are used to constitute the training dataset. Finally, we perform CNNs on this dataset to build a model able to detect the crop and the weeds in the images. The results obtained are comparable to those of traditional supervised training data labeling, with differences in accuracy of 1.5% in the spinach field and 6% in the bean field.
引用
收藏
页数:22
相关论文
共 61 条
[31]   Modelling agronomic images for weed detection and comparison of crop/weed discrimination algorithm performance [J].
Jones, G. ;
Gee, Ch. ;
Truchetet, F. .
PRECISION AGRICULTURE, 2009, 10 (01) :1-15
[32]   Deep learning in agriculture: A survey [J].
Kamilaris, Andreas ;
Prenafeta-Boldu, Francesc X. .
COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2018, 147 :70-90
[33]   Exploiting affine invariant regions and leaf edge shapes for weed detection [J].
Kazmi, Wajahat ;
Garcia-Ruiz, Francisco ;
Nielsen, Jon ;
Rasmussen, Jesper ;
Andersen, Hans Jorgen .
COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2015, 118 :290-299
[34]   ImageNet Classification with Deep Convolutional Neural Networks [J].
Krizhevsky, Alex ;
Sutskever, Ilya ;
Hinton, Geoffrey E. .
COMMUNICATIONS OF THE ACM, 2017, 60 (06) :84-90
[35]  
Latha M., 2014, INT J INNOV RES ELEC, V2
[36]   Gradient-based learning applied to document recognition [J].
Lecun, Y ;
Bottou, L ;
Bengio, Y ;
Haffner, P .
PROCEEDINGS OF THE IEEE, 1998, 86 (11) :2278-2324
[37]  
Lottes P., 2017, 2017 IEEE INT C ROB, P3024, DOI DOI 10.1109/ICRA.2017.7989347
[38]   Unsupervised Classification Algorithm for Early Weed Detection in Row-Crops by Combining Spatial and Spectral Information [J].
Louargant, Marine ;
Jones, Gawain ;
Faroux, Romain ;
Paoli, Jean-Noel ;
Maillot, Thibault ;
Gee, Christelle ;
Villette, Sylvain .
REMOTE SENSING, 2018, 10 (05)
[39]   Weed Mapping in Early-Season Maize Fields Using Object-Based Analysis of Unmanned Aerial Vehicle (UAV) Images [J].
Manuel Pena, Jose ;
Torres-Sanchez, Jorge ;
Isabel de Castro, Ana ;
Kelly, Maggi ;
Lopez-Granados, Francisca .
PLOS ONE, 2013, 8 (10)
[40]   Future Directions of Precision Agriculture [J].
Alex McBratney ;
Brett Whelan ;
Tihomir Ancev ;
Johan Bouma .
Precision Agriculture, 2005, 6 (1) :7-23