SM-CycleGAN: crop image data enhancement method based on self-attention mechanism CycleGAN

被引:0
作者
Liu, Dian [1 ]
Cao, Yang [1 ]
Yang, Jing [1 ,3 ]
Wei, Jianyu [2 ]
Zhang, Jili [2 ]
Rao, Chenglin [1 ]
Wu, Banghong [1 ]
Zhang, Dabin [1 ]
机构
[1] Guizhou Univ, Sch Mech Engn, Guiyang 550025, Peoples R China
[2] China Tobacco Guangxi Ind Co Ltd, Nanning 530000, Peoples R China
[3] Guizhou Univ, State Key Lab Publ Big Data, Guiyang 550025, Peoples R China
来源
SCIENTIFIC REPORTS | 2024年 / 14卷 / 01期
关键词
Self-attention mechanism; Cyclic consistency adversarial network; Tea disease; Tobacco roasting; PSNR; SSIM; QUALITY ASSESSMENT;
D O I
10.1038/s41598-024-59918-3
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Crop disease detection and crop baking stage judgement require large image data to improve accuracy. However, the existing crop disease image datasets have high asymmetry, and the poor baking environment leads to image acquisition difficulties and colour distortion. Therefore, we explore the potential of the self-attention mechanism on crop image datasets and propose an innovative crop image data-enhancement method for recurrent generative adversarial networks (GANs) fused with the self-attention mechanism to significantly enhance the perception and information capture capabilities of recurrent GANs. By introducing the self-attention mechanism module, the cycle-consistent GAN (CycleGAN) is more adept at capturing the internal correlations and dependencies of image data, thus more effectively capturing the critical information among image data. Furthermore, we propose a new enhanced loss function for crop image data to optimise the model performance and meet specific task requirements. We further investigate crop image data enhancement in different contexts to validate the performance and stability of the model. The experimental results show that, the peak signal-to-noise ratio of the SM-CycleGAN for tobacco images and tea leaf disease images are improved by 2.13% and 3.55%, and the structural similarity index measure is improved by 1.16% and 2.48% compared to CycleGAN, respectively.
引用
收藏
页数:19
相关论文
共 51 条
  • [1] Fully synthetic training for image restoration tasks
    Achddou, Raphael
    Gousseau, Yann
    Ladjal, Said
    [J]. COMPUTER VISION AND IMAGE UNDERSTANDING, 2023, 233
  • [2] Artificial Intelligence Enabled Apple Leaf Disease Classification for Precision Agriculture
    Al-Wesabi, Fahd N.
    Albraikan, Amani Abdulrahman
    Hilal, Anwer Mustafa
    Eltahir, Majdy M.
    Hamza, Manar Ahmed
    Zamani, Abu Sarwar
    [J]. CMC-COMPUTERS MATERIALS & CONTINUA, 2022, 70 (03): : 6223 - 6238
  • [3] Almahairi A, 2018, PR MACH LEARN RES, V80
  • [4] Artificial Intelligence-Based Fusion Model for Paddy Leaf Disease Detection and Classification
    Almasoud, Ahmed S.
    Abdelmaboud, Abdelzahir
    Eisa, Taiseer Abdalla Elfadil
    Al Duhayyim, Mesfer
    Elnour, Asma Abbas Hassan
    Hamza, Manar Ahmed
    Motwakel, Abdelwahed
    Zamani, Abu Sarwar
    [J]. CMC-COMPUTERS MATERIALS & CONTINUA, 2022, 72 (01): : 1391 - 1407
  • [5] UAV remote sensing detection of tea leaf blight based on DDMA-YOLO
    Bao, Wenxia
    Zhu, Ziqiang
    Hu, Gensheng
    Zhou, Xingen
    Zhang, Dongyan
    Yang, Xianjun
    [J]. COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2023, 205
  • [6] Lightweight convolutional neural network model for field wheat ear disease identification
    Bao, Wenxia
    Yang, Xinghua
    Liang, Dong
    Hu, Gensheng
    Yang, Xianjun
    [J]. COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2021, 189
  • [7] A surface defect detection system for golden diamond pineapple based on CycleGAN and YOLOv4
    Chen, Ssu-Han
    Lai, Yu-Wei
    Kuo, Chung-Lun
    Lo, Chieh-Yi
    Lin, Yu-Sung
    Lin, Yan-Rung
    Kang, Chih-Hsiang
    Tsai, Chia-Chun
    [J]. JOURNAL OF KING SAUD UNIVERSITY-COMPUTER AND INFORMATION SCIENCES, 2022, 34 (10) : 8041 - 8053
  • [8] Chen X., 2022, NCIT 2022 P INT C NE, P1
  • [9] Apple leaf disease identification via improved CycleGAN and convolutional neural network
    Chen, Yiping
    Pan, Jinchao
    Wu, Qiufeng
    [J]. SOFT COMPUTING, 2023, 27 (14) : 9773 - 9786
  • [10] DFN-PSAN: Multi-level deep information feature fusion extraction network for interpretable plant disease classification
    Dai, Guowei
    Tian, Zhimin
    Fan, Jingchao
    Sunil, C. K.
    Dewi, Christine
    [J]. COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2024, 216