JustDeepIt: Software tool with graphical and character user interfaces for deep learning-based object detection and segmentation in image analysis

被引:3
作者
Sun, Jianqiang [1 ]
Cao, Wei [1 ]
Yamanaka, Takehiko [1 ]
机构
[1] Natl Agr & Food Res Org NARO, Res Ctr Agr Informat Technol, Tsukuba, Japan
来源
FRONTIERS IN PLANT SCIENCE | 2022年 / 13卷
关键词
Deep learning; image recognition; object detection; instance segmentation; leaf segmentation; plant segmentation; graphical user interface;
D O I
10.3389/fpls.2022.964058
中图分类号
Q94 [植物学];
学科分类号
071001 ;
摘要
Image processing and analysis based on deep learning are becoming mainstream and increasingly accessible for solving various scientific problems in diverse fields. However, it requires advanced computer programming skills and a basic familiarity with character user interfaces (CUIs). Consequently, programming beginners face a considerable technical hurdle. Because potential users of image analysis are experimentalists, who often use graphical user interfaces (GUIs) in their daily work, there is a need to develop GUI-based easy-to-use deep learning software to support their work. Here, we introduce JustDeepIt, a software written in Python, to simplify object detection and instance segmentation using deep learning. JustDeepIt provides both a GUI and a CUI. It contains various functional modules for model building and inference, and it is built upon the popular PyTorch, MMDetection, and Detectron2 libraries. The GUI is implemented using the Python library FastAPI, simplifying model building for various deep learning approaches for beginners. As practical examples of JustDeepIt, we prepared four case studies that cover critical issues in plant science: (1) wheat head detection with Faster R-CNN, YOLOv3, SSD, and RetinaNet; (2) sugar beet and weed segmentation with Mask R-CNN; (3) plant segmentation with U-2-Net; and (4) leaf segmentation with U-2-Net. The results support the wide applicability of JustDeepIt in plant science applications. In addition, we believe that JustDeepIt has the potential to be applied to deep learning-based image analysis in various fields beyond plant science.
引用
收藏
页数:9
相关论文
共 44 条
  • [1] Abramoff M. D., 2004, Biophotonics Int., V11, P36
  • [2] Deep learning: as the new frontier in high-throughput plant phenotyping
    Arya, Sunny
    Sandhu, Karansher Singh
    Singh, Jagmohan
    Kumar, Sudhir
    [J]. EUPHYTICA, 2022, 218 (04)
  • [3] DeepMIB: User-friendly and open-source software for training of deep learning network for biological image segmentation
    Belevich, Ilya
    Jokitalo, Eija
    [J]. PLOS COMPUTATIONAL BIOLOGY, 2021, 17 (03)
  • [4] Deep learning for biomedical image reconstruction: a survey
    Ben Yedder, Hanene
    Cardoen, Ben
    Hamarneh, Ghassan
    [J]. ARTIFICIAL INTELLIGENCE REVIEW, 2021, 54 (01) : 215 - 251
  • [5] Boris S., 2021, COMPUTER VISION ANNO
  • [6] Salient object detection: A survey
    Borji, Ali
    Cheng, Ming-Ming
    Hou, Qibin
    Jiang, Huaizu
    Li, Jia
    [J]. COMPUTATIONAL VISUAL MEDIA, 2019, 5 (02) : 117 - 150
  • [7] Brooks J., 2021, COCO ANNOTATOR
  • [8] Agricultural robot dataset for plant classification, localization and mapping on sugar beet fields
    Chebrolu, Nived
    Lottes, Philipp
    Schaefer, Alexander
    Winterhalter, Wera
    Burgard, Wolfram
    Stachniss, Cyrill
    [J]. INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH, 2017, 36 (10) : 1045 - 1052
  • [9] Chen K, 2019, Arxiv, DOI arXiv:1906.07155
  • [10] Applications for deep learning in ecology
    Christin, Sylvain
    Hervet, Eric
    Lecomte, Nicolas
    [J]. METHODS IN ECOLOGY AND EVOLUTION, 2019, 10 (10): : 1632 - 1644