Chrysanthemum classification method integrating deep visual features from both the front and back sides

被引:2
作者
Chen, Yifan [1 ]
Yang, Xichen [1 ]
Yan, Hui [2 ,3 ]
Liu, Jia [4 ]
Jiang, Jian [1 ]
Mao, Zhongyuan [1 ]
Wang, Tianshu [4 ,5 ]
机构
[1] Nanjing Normal Univ, Sch Comp & Elect Informat, Sch Artificial Intelligence, Nanjing, Jiangsu, Peoples R China
[2] Nanjing Univ Chinese Med, Natl & Local Collaborat Engn Ctr Chinese Med Resou, Nanjing, Peoples R China
[3] Nanjing Univ Chinese Med, Jiangsu Collaborat Innovat Ctr Chinese Med Resourc, Nanjing, Jiangsu, Peoples R China
[4] Nanjing Univ Chinese Med, Coll Artificial Intelligence & Informat Technol, Nanjing, Jiangsu, Peoples R China
[5] Nanjing Univ Chinese Med, Jiangsu Prov Engn Res Ctr Tradit Chinese Med TCM I, Nanjing, Jiangsu, Peoples R China
基金
中国国家自然科学基金;
关键词
Chrysanthemum classification; two-stream network; visual information; feature fusion; deep learning;
D O I
10.3389/fpls.2024.1463113
中图分类号
Q94 [植物学];
学科分类号
071001 ;
摘要
Introducion Chrysanthemum morifolium Ramat (hereinafter referred to as Chrysanthemum) is one of the most beloved and economically valuable Chinese herbal crops, which contains abundant medicinal ingredients and wide application prospects. Therefore, identifying the classification and origin of Chrysanthemum is important for producers, consumers, and market regulators. The existing Chrysanthemum classification methods mostly rely on visual subjective identification, are time-consuming, and always need high equipment costs.Methods A novel method is proposed to accurately identify the Chrysanthemum classification in a swift, non-invasive, and non-contact way. The proposed method is based on the fusion of deep visual features of both the front and back sides. Firstly, the different Chrysanthemums images are collected and labeled with origins and classifications. Secondly, the background area with less available information is removed by image preprocessing. Thirdly, a two-stream feature extraction network is designed with two inputs which are the preprocessed front and back Chrysanthemum images. Meanwhile, the incorporation of single-stream residual connections and cross-stream residual connections is employed to extend the receptive field of the network and fully fusion the features from both the front and back sides.Results Experimental results demonstrate that the proposed method achieves an accuracy of 93.8%, outperforming existing methods and exhibiting superior stability.Discussion The proposed method provides an effective and dependable solution for identifying Chrysanthemum classification and origin while offering practical benefits for quality assurance in production, consumer markets, and regulatory processes. Code and data are available at https://github.com/dart-into/CCMIFB.
引用
收藏
页数:17
相关论文
共 49 条
[1]   Intelligent detection and waste control of hawthorn fruit based on ripening level using machine vision system and deep learning techniques [J].
Azadnia, Rahim ;
Fouladi, Saman ;
Jahanbakhshi, Ahmad .
RESULTS IN ENGINEERING, 2023, 17
[2]   Using HVS Dual-Pathway and Contrast Sensitivity to Blindly Assess Image Quality [J].
Chen, Fan ;
Fu, Hong ;
Yu, Hengyong ;
Chu, Ying .
SENSORS, 2023, 23 (10)
[3]   Flavonoids and caffeoylquinic acids in Chrysanthemum morifolium Ramat flowers: A potentially rich source of bioactive compounds [J].
Chen, Sha ;
Liu, Jing ;
Dong, Gangqiang ;
Zhang, Xueting ;
Liu, Yan ;
Sun, Wei ;
Liu, An .
FOOD CHEMISTRY, 2021, 344
[4]   Chemoinformatics based comprehensive two-dimensional liquid chromatography-quadrupole time-of-flight mass spectrometry approach to chemically distinguish Chrysanthemum species [J].
Chen, Yan ;
Zhen, Xiao-Ting ;
Yu, Ya-Ling ;
Shi, Min-Zhen ;
Cao, Jun ;
Zheng, Hui ;
Ye, Li-Hong .
MICROCHEMICAL JOURNAL, 2021, 168
[5]   DFN-PSAN: Multi-level deep information feature fusion extraction network for interpretable plant disease classification [J].
Dai, Guowei ;
Tian, Zhimin ;
Fan, Jingchao ;
Sunil, C. K. ;
Dewi, Christine .
COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2024, 216
[6]   ITF-WPI: Image and text based cross-modal feature fusion model for wolfberry pest recognition [J].
Dai, Guowei ;
Fan, Jingchao ;
Dewi, Christine .
COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2023, 212
[7]   Intelligent detection of citrus fruit pests using machine vision system and convolutional neural network through transfer learning technique [J].
Hadipour-Rokni, Ramazan ;
Asli-Ardeh, Ezzatollah Askari ;
Jahanbakhshi, Ahmad ;
Paeen-Afrakoti, Iman Esmaili ;
Sabzi, Sajad .
COMPUTERS IN BIOLOGY AND MEDICINE, 2023, 155
[8]   Nondestructive Determination and Visualization of Quality Attributes in Fresh and Dry Chrysanthemum morifolium Using Near-Infrared Hyperspectral Imaging [J].
He, Juan ;
Zhu, Susu ;
Chu, Bingquan ;
Bai, Xiulin ;
Xiao, Qinlin ;
Zhang, Chu ;
Gong, Jinyan .
APPLIED SCIENCES-BASEL, 2019, 9 (09)
[9]   Masked Autoencoders Are Scalable Vision Learners [J].
He, Kaiming ;
Chen, Xinlei ;
Xie, Saining ;
Li, Yanghao ;
Dollar, Piotr ;
Girshick, Ross .
2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, :15979-15988
[10]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778