A high-resolution, multimodal data set for agricultural robotics: A Ladybird's-eye view of Brassica

被引:47
作者
Bender, Asher [1 ]
Whelan, Brett [2 ]
Sukkarieh, Salah [1 ]
机构
[1] Univ Sydney, Australian Ctr Field Robot, Sydney, NSW 2006, Australia
[2] Univ Sydney, Sydney Inst Agr, Sch Life & Environm Sci, Sydney, NSW, Australia
关键词
agricultural robotics; data set; hyperspectral imaging; object detection; precision agriculture; semantic segmentation; thermal imaging; CLASSIFICATION; VISION; NETWORKS; IMAGES;
D O I
10.1002/rob.21877
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
This article presents an agricultural data set collected by Ladybird, an autonomous field robot designed at the Australian Centre for Field Robotics. The data set contains weekly scans of cauliflower and broccoli (Brassica oleracea) covering a 10 week growth cycle from transplant to harvest. The data set includes ground truth; physical characteristics of the crop; environmental data collected by a weather station and a soil sensor network; and scans of the crop performed by Ladybird, which include stereo color, thermal and hyperspectral imagery. The layout of the farm and data collection methodology are described. A description of Ladybird's capabilities and sensors are provided. Benchmark results are provided to illustrate the contents of the data set and how it can be processed. The hyperspectral data are compiled into hypercubes and the pixels are classified into crop, weed, or soil. An object detector is applied to the color imagery to locate the crop. Our intention in releasing the data set is to facilitate robotics and machine learning research activity in agriculture. The data set can be downloaded from .
引用
收藏
页码:73 / 96
页数:24
相关论文
共 51 条
[1]   The Advanced Spaceborne Thermal Emission and Reflection Radiometer (ASTER): data products for the high spatial resolution imager on NASA's Terra platform [J].
Abrams, M .
INTERNATIONAL JOURNAL OF REMOTE SENSING, 2000, 21 (05) :847-859
[2]   The Importance of Accounting for Atmospheric Effects in the Application of NDVI and Interpretation of Satellite Imagery Supporting Archaeological Research: The Case Studies of Palaepaphos and Nea Paphos Sites in Cyprus [J].
Agapiou, Athos ;
Hadjimitsis, Diofantos G. ;
Papoutsa, Christiana ;
Alexakis, Dimitrios D. ;
Papadavid, George .
REMOTE SENSING, 2011, 3 (12) :2605-2629
[3]   Robust pixel-based classification of obstacles for robotic harvesting of sweet-pepper [J].
Bac, C. W. ;
Hemming, J. ;
van Henten, E. J. .
COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2013, 96 :148-162
[4]   Harvesting Robots for High-value Crops: State-of-the-art Review and Challenges Ahead [J].
Bac, C. Wouter ;
van Henten, Eldert J. ;
Hemming, Jochen ;
Edan, Yael .
JOURNAL OF FIELD ROBOTICS, 2014, 31 (06) :888-911
[5]  
Bargoti Suchet, 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA), P3626, DOI 10.1109/ICRA.2017.7989417
[6]   A Robot System for Pruning Grape Vines [J].
Botterill, Tom ;
Paulin, Scott ;
Green, Richard ;
Williams, Samuel ;
Lin, Jessica ;
Saxton, Valerie ;
Mills, Steven ;
Chen, XiaoQi ;
Corbett-Davies, Sam .
JOURNAL OF FIELD ROBOTICS, 2017, 34 (06) :1100-1122
[7]   Agricultural robot dataset for plant classification, localization and mapping on sugar beet fields [J].
Chebrolu, Nived ;
Lottes, Philipp ;
Schaefer, Alexander ;
Winterhalter, Wera ;
Burgard, Wolfram ;
Stachniss, Cyrill .
INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH, 2017, 36 (10) :1045-1052
[8]  
Cocks T, 1998, 1ST EARSEL WORKSHOP ON IMAGING SPECTROSCOPY, P37
[9]   The Cityscapes Dataset for Semantic Urban Scene Understanding [J].
Cordts, Marius ;
Omran, Mohamed ;
Ramos, Sebastian ;
Rehfeld, Timo ;
Enzweiler, Markus ;
Benenson, Rodrigo ;
Franke, Uwe ;
Roth, Stefan ;
Schiele, Bernt .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :3213-3223
[10]  
Dai J., 2016, Advances in neural information processing systems, P379