Generation and application of hyperspectral 3D plant models: methods and challenges

被引:81
作者
Behmann, Jan [1 ]
Mahlein, Anne-Katrin [2 ]
Paulus, Stefan [3 ]
Dupuis, Jan [3 ]
Kuhlmann, Heiner [3 ]
Oerke, Erich-Christian [2 ]
Pluemer, Lutz [1 ]
机构
[1] Univ Bonn, Inst Geodesy & Geoinformat IGG Geoinformat, Bonn, Germany
[2] Univ Bonn, Inst Crop Sci & Resource Conservat INRES Phytomed, Bonn, Germany
[3] Univ Bonn, Inst Geodesy & Geoinformat IGG Geodesy, Bonn, Germany
关键词
Hyperspectral; 3D scanning; Close range; Plant phenotyping; Modeling; Sensor fusion; REFLECTANCE; QUANTIFICATION; RESPONSES; CAMERAS; SYSTEM; GROWTH; LIDAR;
D O I
10.1007/s00138-015-0716-8
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Hyperspectral imaging sensors have been introduced for measuring the health status of plants. Recently, they also have been used for close-range sensing of plant canopies with a highly complex architecture. However, the complex geometry of plants and their interaction with the illumination setting severely affect the spectral information obtained. Furthermore, the spatial component of analysis results gain in importance as higher plants are represented by multiple plant organs as leaves, stems and seed pods. The combination of hyperspectral images and 3D point clouds is a promising approach to face these problems. We present the generation and application of hyperspectral 3D plant models as a new, interesting application field for computer vision with a variety of challenging tasks. We sum up a geometric calibration method for hyperspectral pushbroom cameras using a reference object for the combination of spectral and spatial information. Furthermore, we show exemplarily new calibration and analysis methods enabled by the hyperspectral 3D models in an experiment with sugar beet plants. An improved normalization, a comparison of image and 3D analysis and the density estimation of infected surface points underline some of the new capabilities gained using this new data type. Based on such hyperspectral 3D models the effects of plant geometry and sensor configuration can be quantified and modeled. In future, reflectance models can be used to remove or weaken the geometry-related effects in hyperspectral images and, therefore, have the potential to improve automated plant phenotyping significantly.
引用
收藏
页码:611 / 624
页数:14
相关论文
共 35 条
[1]  
Bannehr L, 2011, INT ARCH PHOTOGRAMM, V39-4, P17
[2]   Low-weight and UAV-based Hyperspectral Full-frame Cameras for Monitoring Crops: Spectral Comparison with Portable Spectroradiometer Measurements [J].
Bareth, Georg ;
Aasen, Helge ;
Bendig, Juliane ;
Gnyp, Martin Leon ;
Bolten, Andreas ;
Jung, Andras ;
Michels, Rene ;
Soukkamaki, Jussi .
PHOTOGRAMMETRIE FERNERKUNDUNG GEOINFORMATION, 2015, (01) :69-79
[3]  
Behmann J., 2014, COMPUTER VISION, P117
[4]   Calibration of hyperspectral close-range pushbroom cameras for plant phenotyping [J].
Behmann, Jan ;
Mahlein, Anne-Katrin ;
Paulus, Stefan ;
Kuhlmann, Heiner ;
Oerke, Erich-Christian ;
Pluemer, Lutz .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2015, 106 :172-182
[5]   Detection of early plant stress responses in hyperspectral images [J].
Behmann, Jan ;
Steinruecken, Joerg ;
Pluemer, Lutz .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2014, 93 :98-111
[6]   Computer Reconstruction of Plant Growth and Chlorophyll Fluorescence Emission in Three Spatial Dimensions [J].
Bellasio, Chandra ;
Olejnickova, Julie ;
Tesar, Radek ;
Sebela, David ;
Nedbal, Ladislav .
SENSORS, 2012, 12 (01) :1052-1071
[7]   HyperART: non-invasive quantification of leaf traits using hyperspectral absorption-reflectance-transmittance imaging [J].
Bergstraesser, Sergej ;
Fanourakis, Dimitrios ;
Schmittgen, Simone ;
Cendrero-Mateo, Maria Pilar ;
Jansen, Marcus ;
Scharr, Hanno ;
Rascher, Uwe .
PLANT METHODS, 2015, 11
[8]   A stereo imaging system for measuring structural parameters of plant canopies [J].
Biskup, Bernhard ;
Scharr, Hanno ;
Schurr, Ulrich ;
Rascher, Uwe .
PLANT CELL AND ENVIRONMENT, 2007, 30 (10) :1299-1308
[9]   Leaf BRDF measurements and model for specular and diffuse components differentiation [J].
Bousquet, L ;
Lachérade, S ;
Jacquemoud, S ;
Moya, I .
REMOTE SENSING OF ENVIRONMENT, 2005, 98 (2-3) :201-211
[10]   Angular Dependency of Hyperspectral Measurements over Wheat Characterized by a Novel UAV Based Goniometer [J].
Burkart, Andreas ;
Aasen, Helge ;
Alonso, Luis ;
Menz, Gunter ;
Bareth, Georg ;
Rascher, Uwe .
REMOTE SENSING, 2015, 7 (01) :725-746