JVCSR: Video Compressive Sensing Reconstruction with Joint In-Loop Reference Enhancement and Out-Loop Super-Resolution

Taking advantage of spatial and temporal correlations, deep learning-based video compressive sensing reconstruction (VCSR) technologies have tremendously improved reconstructed video quality. Existing VCSR works mainly focus on improving deep learning-based motion compensation without optimizing local and global information, leaving much space for further improvements. This paper proposes a video compressive sensing reconstruction method with joint in-loop reference enhancement and out-loop super-resolution (JVCSR), focusing on removing reconstruction artifacts and increasing the resolution simultaneously. As an in-loop part, the enhanced frame is utilized as a reference to improve the recovery performance of the current frame. Furthermore, it is the first time to propose out-loop super-resolution for VCSR to obtain high-quality images at low bitrates. As a result, JVCSR obtains an average improvement of 1.37 dB PSNR compared with state-of-the-art compressive sensing methods at the same bitrate.