DAEANet: Dual auto-encoder attention network for depth map super-resolution

Recently, depth map super-resolution (DSR) has obtained remarkable performance with the development of convolutional neural networks (CNNs). High-resolution (HR) depth map can be inferred from a low resolution (LR) one with the guidance of its corresponding HR intensity image. However, most of the existing CNNs-based methods unilaterally transfer structures information of guidance image to the input depth map, which ignores the corresponding relations between the depth map and the intensity map. In this paper, we propose a novel dual auto-encoder attention network (DAEANet) for DSR. The proposed DAEANet includes two auto-encoder networks, where guidance auto-encoder network (GAENet) and target auto-encoder network (TAENet) aim to extract feature information from intensity image and depth map. Specifically, all auto-encoder networks are similar and trained simultaneously to ensure structural consistency. Furthermore, to preserve the structure information in the process of training, the attention mechanism is employed to our DAEANet. Extensive experiments on several popular benchmarks show that the proposed DAEANet outperforms existing state-of-the-art algorithms. (c) 2021 Elsevier B.V. All rights reserved.