Pheno-Deep Counter: a unified and versatile deep learning architecture for leaf counting

被引:71
作者
Giuffrida, Mario Valerio [1 ,2 ]
Doerner, Peter [3 ]
Tsaftaris, Sotirios A. [1 ,4 ]
机构
[1] Univ Edinburgh, Sch Engn, Inst Digital Commun, Thomas Bayes Rd, Edinburgh EH9 3FG, Midlothian, Scotland
[2] IMT Sch Adv Studies, Piazza S Francesco 19, I-55100 Lucca, Italy
[3] Univ Edinburgh, Sch Biol Sci, Mayfield Rd, Edinburgh EH9 3JR, Midlothian, Scotland
[4] Alan Turing Inst, 96 Euston Rd, London NW1 2DB, England
基金
英国生物技术与生命科学研究理事会;
关键词
image-based plant phenotyping; machine learning; deep learning; leaf counting; multimodal; night images; PLANT; ARABIDOPSIS; PHOTOPERIOD; PLATFORM; GROWTH; SYSTEM;
D O I
10.1111/tpj.14064
中图分类号
Q94 [植物学];
学科分类号
071001 ;
摘要
Direct observation of morphological plant traits is tedious and a bottleneck for high-throughput phenotyping. Hence, interest in image-based analysis is increasing, with the requirement for software that can reliably extract plant traits, such as leaf count, preferably across a variety of species and growth conditions. However, current leaf counting methods do not work across species or conditions and therefore may lack broad utility. In this paper, we present Pheno-Deep Counter, a single deep network that can predict leaf count in two-dimensional (2D) plant images of different species with a rosette-shaped appearance. We demonstrate that our architecture can count leaves from multi-modal 2D images, such as visible light, fluorescence and near-infrared. Our network design is flexible, allowing for inputs to be added or removed to accommodate new modalities. Furthermore, our architecture can be used as is without requiring dataset-specific customization of the internal structure of the network, opening its use to new scenarios. Pheno-Deep Counter is able to produce accurate predictions in many plant species and, once trained, can count leaves in a few seconds. Through our universal and open source approach to deep counting we aim to broaden utilization of machine learning-based approaches to leaf counting. Our implementation can be downloaded at .
引用
收藏
页码:880 / 890
页数:11
相关论文
共 45 条
[1]   Leaf Counting with Deep Convolutional and Deconvolutional Networks [J].
Aich, Shubhra ;
Stavness, Ian .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW 2017), 2017, :2080-2089
[2]   Modeling leaf growth of rosette plants using infrared stereo image sequences [J].
Aksoy, Eren Erdal ;
Abramov, Alexey ;
Woergoetter, Florentin ;
Scharr, Hanno ;
Fischbach, Andreas ;
Dellen, Babette .
COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2015, 110 :78-90
[3]  
[Anonymous], P COMP VIS PROBL PLA
[4]   Phytotyping4D: a light-field imaging system for non-invasive and accurate monitoring of spatio-temporal plant growth [J].
Apelt, Federico ;
Breuer, David ;
Nikoloski, Zoran ;
Stitt, Mark ;
Kragler, Friedrich .
PLANT JOURNAL, 2015, 82 (04) :693-706
[5]  
Bell J., 2016, Aberystwyth leaf evaluation dataset
[6]  
Bengio Y., 2012, P ICML WORKSH UNS TR, V27, P17, DOI DOI 10.1109/IJCNN.2011.6033302
[7]   Growth stage-based phenotypic analysis of arabidopsis:: A model for high throughput functional genomics in plants [J].
Boyes, DC ;
Zayed, AM ;
Ascenzi, R ;
McCaskill, AJ ;
Hoffman, NE ;
Davis, KR ;
Görlach, J .
PLANT CELL, 2001, 13 (07) :1499-1510
[8]   Multimodal MR Synthesis via Modality-Invariant Latent Representation [J].
Chartsias, Agisilaos ;
Joyce, Thomas ;
Giuffrida, Mario Valerio ;
Tsaftaris, Sotirios A. .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2018, 37 (03) :803-814
[9]   Differential regulation of trichome formation on the adaxial and abaxial leaf surfaces by Gibberellins and photoperiod in Arabidopsis thaliana (L) Heynh [J].
Chien, JC ;
Sussex, IM .
PLANT PHYSIOLOGY, 1996, 111 (04) :1321-1328
[10]  
Chollet F., 2015, about us