Monitoring leaf nitrogen content in rice based on information fusion of multi-sensor imagery from UAV

Timely and accurately monitoring leaf nitrogen content (LNC) is essential for evaluating crop nutrition status. Currently, Unmanned Aerial Vehicles (UAV) imagery is becoming a potentially powerful tool of assessing crop nitrogen status in fields, but most of crop nitrogen estimates based on UAV remote sensing usually use single type imagery, the fusion information from different types of imagery has rarely been considered. In this study, the fusion images were firstly made from the simultaneously acquired digital RGB and multi-spectral images from UAV at three growth stages of rice, and then couple the selecting methods of optimal features with machine learning algorithms for the fusion images to estimate LNC in rice. Results showed that the combination with different types of features could improve the models’ accuracy effectively, the combined inputs with bands, vegetation indices (VIs) and Grey Level Co-occurrence Matrices (GLCMs) have the better performance. The LNC estimation of using fusion images was improved more obviously than multispectral those, and there was the best estimation at jointing stage based on Lasso Regression (LR), with R2 of 0.66 and RMSE of 11.96%. Gaussian Process Regression (GPR) algorithm used in combination with one feature-screening method of Minimum Redundancy Maximum Correlation (mRMR) for the fusion images, showed the better improvement to LNC estimation, with R2 of 0.68 and RMSE of 11.45%. It indicates that the information fusion from UAV multi-sensor imagery can significantly improve crop LNC estimates and the combination with multiple types of features also has a great potential for evaluating LNC in crops.