Fully automated proximal hyperspectral imaging system for high-resolution and high-quality in vivo soybean phenotyping

被引:5
作者
Chen, Ziling [1 ]
Wang, Jialei [2 ]
Jin, Jian [1 ]
机构
[1] Purdue Univ, Dept Agr & Biol Engn, 225 S Univ St, W Lafayette, IN 47907 USA
[2] Purdue Univ, Sch Mech Engn, 585 Purdue Mall, W Lafayette, IN 47907 USA
关键词
Soybean; Plant phenotyping; Hyperspectral imaging; LeafSpec; Robotic system; Precision agriculture; Proximal sensing; Robot; GLYCINE-MAX; REFLECTANCE; VARIETIES;
D O I
10.1007/s11119-023-10045-5
中图分类号
S [农业科学];
学科分类号
09 ;
摘要
Hyperspectral imaging (HSI) is a prevalent method in crop phenotyping. Nevertheless, current HSI remote sensing techniques are compromised by changing ambient lighting conditions, long imaging distances, and comparatively low resolutions. Proximal HSI sensors such as LeafSpec were developed to improve the imaging quality. However, the application of proximal sensors remains contrained by their low throughput and intensive labor costs. Moreover, few automation solutions were available to use LeafSpec in phenotyping dicot plants. In this paper, a novel robotic system is presented as a sensor platform to operate LeafSpec to collect leaf-level hyperspectral images for in vivo phenotyping of soybean. A machine vision algorithm was developed to detect the top mature trifoliate and estimate the poses of the leaflets. A control and motion planning algorithm was developed for an articulated robotic manipulator to grasp the target leaflets. An experiment was conducted in March 2021 in a greenhouse with 64 soybean plants of 2 genotypes and 2 nitrogen treatments. The machine vision detected the target leaflets with a first trial success rate of 84.13% and an overall success rate of 90.66%. The robotic manipulator operated LeafSpec to image the target leaflets with a first trial success rate of 87.30% and an overall success rate of 93.65%. The average cycle time for one soybean plant was 63.20 s. The PLS predictions from the robot-collected data had an R-2 of 0.84 with the measured nitrogen content and an R-2 of 0.82 with the predictions from human-collected data. The results demonstrated the potential of applying the system for automated in vivo leaf-level HSI for soybean phenotyping in the field.
引用
收藏
页码:2395 / 2415
页数:21
相关论文
共 33 条
[1]   In vivo human-like robotic phenotyping of leaf traits in maize and sorghum in greenhouse [J].
Atefi, Abbas ;
Ge, Yufeng ;
Pitla, Santosh ;
Schnable, James .
COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2019, 163
[2]   3D Perception-Based Collision-Free Robotic Leaf Probing for Automated Indoor Plant Phenotyping [J].
Bao, Y. ;
Shah, D. ;
Tang, L. .
TRANSACTIONS OF THE ASABE, 2018, 61 (03) :859-872
[3]   Soybean Yield Loss Estimates Due to Diseases in the United States and Ontario, Canada, from 2015 to 2019 [J].
Bradley, Carl A. ;
Allen, Tom W. ;
Sisson, Adam J. ;
Bergstrom, Gary C. ;
Bissonnette, Kaitlyn M. ;
Bond, Jason ;
Byamukama, Emmanuel ;
Chilvers, Martin, I ;
Collins, Alyssa A. ;
Damicone, John P. ;
Dorrance, Anne E. ;
Dufault, Nicholas S. ;
Esker, Paul D. ;
Faske, Travis R. ;
Fiorellino, Nicole M. ;
Giesler, Loren J. ;
Hartman, Glen L. ;
Hollier, Clayton A. ;
Isakeit, Tom ;
Jackson-Ziems, Tamra A. ;
Jardine, Douglas J. ;
Kelly, Heather M. ;
Kemerait, Robert C. ;
Kleczewski, Nathan M. ;
Koehler, Alyssa M. ;
Kratochvil, Robert J. ;
Kurle, James E. ;
Malvick, Dean K. ;
Markell, Samuel G. ;
Mathew, Febina M. ;
Mehl, Hillary L. ;
Mehl, Kelsey M. ;
Mueller, Daren S. ;
Mueller, John D. ;
Nelson, Berlin D. ;
Overstreet, Charles ;
Padgett, G. Boyd ;
Price, Paul P. ;
Sikora, Edward J. ;
Small, Ian ;
Smith, Damon L. ;
Spurlock, Terry N. ;
Tande, Connie A. ;
Telenko, Darcy E. P. ;
Tenuta, Albert U. ;
Thiessen, Lindsey D. ;
Warner, Fred ;
Wiebold, William J. ;
Wise, Kiersten A. .
PLANT HEALTH PROGRESS, 2021, 22 (04) :483-495
[4]  
Campbell T., 2021, [No title captured], Patent No. [TSC07921, 07921]
[5]   Automated in-field leaf-level hyperspectral imaging of corn plants using a Cartesian robotic platform [J].
Chen, Ziling ;
Wang, Jialei ;
Wang, Tao ;
Song, Zhihang ;
Li, Yikai ;
Huang, Yuanmeng ;
Wang, Liangju ;
Jin, Jian .
COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2021, 183
[6]   Soybean varieties discrimination using non-imaging hyperspectral sensor [J].
da Silva Junior, Carlos Antonio ;
Nanni, Marcos Rafael ;
Shakir, Muhammad ;
Teodoro, Paulo Eduardo ;
de Oliveira-Junior, Jose Francisco ;
Cezar, Everson ;
de Gois, Givanildo ;
Lima, Mendelson ;
Wojciechowski, Julio Cesar ;
Shiratsuchi, Luciano Shozo .
INFRARED PHYSICS & TECHNOLOGY, 2018, 89 :338-350
[7]   Detection of soybean rust using a multispectral image sensor [J].
Cui D. ;
Zhang Q. ;
Li M. ;
Zhao Y. ;
Hartman G.L. .
Sensing and Instrumentation for Food Quality and Safety, 2009, 3 (1) :49-56
[8]  
fao, 2021, World Food and Agriculture-Statistical Yearbook 2021, DOI DOI 10.4060/CB1329EN
[9]  
Fehr W. R., 1977, Special Report, Agriculture and Home Economics Experiment Station, Iowa State University
[10]   Random forest and leaf multispectral reflectance data to differentiate three soybean varieties from two pigweeds [J].
Fletcher, Reginald S. ;
Reddy, Krishna N. .
COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2016, 128 :199-206