Complex-valued Neural Network for Hyperspectral Single Image Super Resolution

Remote sensing applications are nowadays widely spread in various industrial fields, such as mineral and water exploration, geo-structural mapping, and natural hazards analysis. These applications require that the performance of image processing tasks, such as segmentation, object detection, and classification, to be of high accuracy. This can be achieved with relative ease if the given image has high spatial resolution as well as high spectral resolution. However, due to sensor limitations, spatial and spectral resolutions have an inherently inverse relationship and cannot be achieved simultaneously. Hyperspectral Images (HSI) have high spectral resolution, but suffer from low spatial resolution, which hinders utilizing them to their full potential. One of the most widely used approaches to enhance spatial resolution is Single Image Super Resolution (SISR) techniques. In the recent years, Deep Convolutional Neural Networks (DCNNs) have been widely used for HSI enhancement, as they have shown superiority over other traditional methods. Nonetheless, researches still aspire to enhance HSI quality further while overcoming common challenges, such as spectral distortions. Research has shown that properties of natural images can be easily captured using complex numbers. However, this has not been thoroughly investigated from the perspective of HSI SISR. In this paper, we propose a variation of a Complex Valued Neural Network (CVNN) architecture for HSI spatial enhancement. The benefits of approaching the problem from a frequency domain perspective will be answered and the proposed network will be compared to its real counterpart and other state-of-the-art approaches. The evaluation and comparison will be recorded qualitatively by visual comparison, and quantitatively using Peak Signal-to-Noise Ratio (PSNR), Structural Similarity Index (SSIM), and Spectral Angle Mapper (SAM). The project can be access at: https://github.com/NourO93/3D_CCVNN_Hyperspectral.