Hyperspectral image dynamic range reconstruction using deep neural network-based denoising methods

被引:0
|
作者
Cheplanov, Loran [1 ,2 ]
Avidan, Shai [1 ]
Bonfil, David J. [3 ]
Klapp, Iftach [2 ]
机构
[1] Tel Aviv Univ, Sch Elect Engn, IL-69978 Tel Aviv, Israel
[2] Agr Res Org, Volcani Inst, Dept Sensing Informat & Mechanizat Engn, IL-7505101 Rishon Leziyyon, Israel
[3] Agr Res Org, Dept Vegetables & Field Crops, Gilat Res Ctr, IL-8531100 Negev, Israel
关键词
Deep neural network; Dynamic-range reconstruction; Shortening shooting time; Hyperspectral; Image denoising; Kullback-Leibler divergence loss;
D O I
10.1007/s00138-024-01523-5
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Hyperspectral (HS) measurement is among the most useful tools in agriculture for early disease detection. However, the cost of HS cameras that can perform the desired detection tasks is prohibitive-typically fifty thousand to hundreds of thousands of dollars. In a previous study at the Agricultural Research Organization's Volcani Institute (Israel), a low-cost, high-performing HS system was developed which included a point spectrometer and optical components. Its main disadvantage was long shooting time for each image. Shooting time strongly depends on the predetermined integration time of the point spectrometer. While essential for performing monitoring tasks in a reasonable time, shortening integration time from a typical value in the range of 200 ms to the 10 ms range results in deterioration of the dynamic range of the captured scene. In this work, we suggest correcting this by learning the transformation from data measured with short integration time to that measured with long integration time. Reduction of the dynamic range and consequent low SNR were successfully overcome using three developed deep neural networks models based on a denoising auto-encoder, DnCNN and LambdaNetworks architectures as a backbone. The best model was based on DnCNN using a combined loss function of l2\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\ell _{2}$$\end{document} and Kullback-Leibler divergence on images with 20 consecutive channels. The full spectrum of the model achieved a mean PSNR of 30.61 and mean SSIM of 0.9, showing total improvement relatively to the 10 ms measurements' mean PSNR and mean SSIM values by 60.43% and 94.51%, respectively.
引用
收藏
页数:14
相关论文
共 50 条
  • [21] RCRC: A Deep Neural Network for Dynamic Image Reconstruction of Electrical Impedance Tomography
    Ren, Shangjie
    Guan, Ru
    Liang, Guanghui
    Dong, Feng
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2021, 70
  • [22] Image Denoising using Convolutional Neural Network
    Mehmood, Asif
    PATTERN RECOGNITION AND TRACKING XXXI, 2020, 11400
  • [23] Denoising Prior Driven Deep Neural Network for Image Restoration
    Dong, Weisheng
    Wang, Peiyao
    Yin, Wotao
    Shi, Guangming
    Wu, Fangfang
    Lu, Xiaotong
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2019, 41 (10) : 2305 - 2318
  • [24] Convolutional neural network-based image denoising for synchronous measurement of temperature and deformation at elevated temperature
    Wang, Jinyang
    Tang, Yunlong
    Zhang, Jinsong
    Yue, Mengkun
    Feng, Xue
    OPTIK, 2021, 241
  • [25] Population and Individual Information Guided PET Image Denoising Using Deep Neural Network
    Cui, Jianan
    Gong, Kuang
    Guo, Ning
    Wu, Chenxi
    Kim, Kyungsang
    Liu, Huafeng
    Li, Quanzheng
    15TH INTERNATIONAL MEETING ON FULLY THREE-DIMENSIONAL IMAGE RECONSTRUCTION IN RADIOLOGY AND NUCLEAR MEDICINE, 2019, 11072
  • [26] Coupled Convolutional Neural Network-Based Detail Injection Method for Hyperspectral and Multispectral Image Fusion
    Lu, Xiaochen
    Yang, Dezheng
    Jia, Fengde
    Zhao, Yifeng
    APPLIED SCIENCES-BASEL, 2021, 11 (01): : 1 - 13
  • [27] Low-dose CT reconstruction with simultaneous sinogram and image domain denoising by deep neural network
    Zhu, Jiongtao
    Su, Ting
    Deng, Xiaolei
    Sun, Xindong
    Zheng, Hairong
    Liang, Dong
    Ge, Yongshuai
    MEDICAL IMAGING 2020: PHYSICS OF MEDICAL IMAGING, 2020, 11312
  • [28] A performance comparison of convolutional neural network-based image denoising methods: The effect of loss functions on low-dose CT images
    Kim, Byeongjoon
    Han, Minah
    Shim, Hyunjung
    Baek, Jongduk
    MEDICAL PHYSICS, 2019, 46 (09) : 3906 - 3923
  • [29] HYPERSPECTRAL IMAGE CLASSIFICATION USING TWO-CHANNEL DEEP CONVOLUTIONAL NEURAL NETWORK
    Yang, Jingxiang
    Zhao, Yongqiang
    Chan, Jonathan Cheung-Wai
    Yi, Chen
    2016 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS), 2016, : 5079 - 5082
  • [30] Deep Convolutional Neural Network Denoising for Digital Breast Tomosynthesis Reconstruction
    Gao, Mingjie
    Samala, Ravi K.
    Fessler, Jeffrey A.
    Chan, Heang-Ping
    MEDICAL IMAGING 2020: PHYSICS OF MEDICAL IMAGING, 2020, 11312