Fusing Multispectral Imaging and Deep Learning in Plant Chlorophyll Index Detection System

被引：0

作者：

Wang N. ^{[1
]}

Li Z. ^{[1
]}

Li J. ^{[2
]}

Zhang Y. ^{[3
]}

Sun H. ^{[1
,2
]}

Li M. ^{[1
,3
]}

机构：

[1] Key Laboratory of Smart Agriculture Systems Integration, Ministry of Education, China Agricultural University, Beijing

[2] Key Laboratory of Agricultural Information Acquisition Technology, Ministry of Agriculture and Rural Affairs, China Agricultural University, Beijing

[3] Yantai Institute of China Agricultural University, Yantai

来源：

Nongye Jixie Xuebao/Transactions of the Chinese Society for Agricultural Machinery | 2023年 / 54卷

关键词：

chlorophyll content detection; deep learning; maize; multispectral imaging; plant core identification; target detection;

D O I：

10.6041/j.issn.1000-1298.2023.S2.031

中图分类号：

学科分类号：

摘要：

In order to meet the needs of rapid detection of field crop growth and guiding variable management, a field crop chlorophyll intelligent detection system based on multi-spectral imaging was designed and developed with maize as an example. It included visible light (RGB) and near-infrared (NIR) image acquisition module, main control processor module, model acceleration module, display and power module, which was used to realize intelligent identification of corn plants and integrated detection of chlorophyll index. Firstly, the canopy image data set of maize seedling stage and jointing stage were collected, and two deep learning models of plant canopy instance segmentation and plant center target detection were compared. A corn plant location detection model based on MobileDet + SSDLite (single shot multibox detector lite) lightweight network was constructed to realize corn plant identification. Secondly, the identified plant heart RGB NIR images were extracted, the matching and segmentation of RGB and NIR images were carried out, and the gray values of R, G, B and NIR were extracted to calculate the vegetation index. SPXY algorithm (sample set portioning based on joint X Y distances) and SPA (successive projections algorithm) were used. The samples of the dataset were divided and the characteristic variables were screened, and then GPR (Gaussian process regression) algorithm was selected to establish the chlorophyll index detection model. The results showed that the recognition rate of the model reached 88. 7% in the complex environment of occlusion overlap, and the recognition accuracy reached more than 90% in the non-overlapping environment. The model determination coefficient R of the modeling set of the chlorophyll content index detection model was 0. 62, and the model determination coefficient R of the test set was 0. 61. Field tests on the developed system showed that the detection rate of the system can reach 14. 6 frames per second, and the average accuracy was 92. 9%. The research results can effectively solve the problem of corn nutritional status detection in field environment, meeting the real-time detection requirements of field environment, and providing solutions and technical support for intelligent perception of crop production. © 2023 Chinese Society of Agricultural Machinery. All rights reserved.

引用

页码：260 / 269

页数：9

共 37 条

[1]

WANG Pengxin, TIAN Huiren, ZHANG Yue, Et al., Crop growth monitoring and yield estimation based on deep learning

[2]

state of the art and beyond[J], Transactions of the Chinese Society for Agricultural Machinery, 53, 2, pp. 1-14, (2022)

[3]

FIEUZAL R, MARAIS S C, BAUP F., Estimation of corn yield using multi-temporal optical and radar satellite data and artificial neural networks, International Journal of Applied Earth Observation and Geoinformation, 57, (2017)

[4]

FORTIN J G, ANCTIL F, PARENT L, Et al., Site-specific early season potato yield forecast by neural network in Eastern Canada, Precision Agriculture, 12, 6, pp. 905-923, (2011)

[5]

LIU Ghengliang, LIN Hongzhen, LI Yanming, Et al., Analysis on status and development trend of intelligent control technology for agricultural equipment [J], Transactions of the Chinese Society for Agricultural Machinery, 51, 1, pp. 1-18, (2020)

[6]

LIU W, ANGUELOV D, ERHAN D, Et al., SSD: single shot multibox detector [C], Proceedings of the 14th European Conference on Computer Vision, pp. 21-37, (2016)

[7]

REDMON J, DIVVALA S, GIRSHICK R, Et al., You only look once: unified, real-time object detection, 2016 IEEE Conference on Computer Vision and Pattern Recognition, (2016)

[8]

HE K, GKIOXARI G, DOLLAR P, Et al., Mask R - CNN, IEEE Transactions on Pattern Analysis and Machine Intelligence, 42, 2, pp. 386-397, (2020)

[9]

BOLYA D, ZHOU C, XIAO F, Et al., YOLACT: real-time instance segmentation [J], IEEE Transactions on Pattern Analysis and Machine Intelligence, (2019)

[10]

ZONG Ze, ZHAO Shuo, LIU Gang, Coronal identification and centroid location of maize seedling stage[J], Transactions of the Chinese Society for Agricultural Machinery, 50, (2019)

← 1 2 3 4 →