Knowledge distillation in plant disease recognition

Recognizing the plant disease and pests in its golden time is a highly critical problem to be addressed, since the herbalist can apply treatments within this period and save the agricultural product. In this paper, a deep learning approach to recognize the disease from the leaves of the plants has been pursued. A client-server system is proposed in which the server-side model can leverage huge deep CNN architectures to classify the diseases, whereas the client-side model is to be chosen among small deep CNN architectures with low number of parameters in order to be easily deployed on the end-user mobile devices with poor processing powers. Here, a novel knowledge distillation technique has been leveraged that improves the accuracy level of the small client-side model significantly. This technique distills the perception knowledge of a large model classifier and transfers this knowledge to the small model in order to perform a similar prediction capability. By applying this idea on Plantvillage dataset, we could achieve 97.58%\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$97.58\%$$\end{document} accuracy on a small MobileNet architecture which is very close to the accuracy of a large Xception model on the server with 99.73%\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$99.73\%$$\end{document} accuracy. Through applying this teacher-student idea, we could improve the classification rate of the state-of-the-art tiny model by 2.12%\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$2.12\%$$\end{document}.