Thermal Image Super-resolution: A Novel Architecture and Dataset

被引:41
作者
Rivadeneira, Rafael E. [1 ]
Sappa, Angel D. [1 ,2 ]
Vintimilla, Boris X. [1 ]
机构
[1] Escuela Super Politecn Litoral, ESPOL, Fac Ingn Elect & Computac, CIDIS, Campus Gustavo Galindo,Km 30-5 Via Perimetral, Guayaquil, Ecuador
[2] Comp Vis Ctr, Edifici O,Campus DAB, Barcelona 08193, Spain
来源
VISAPP: PROCEEDINGS OF THE 15TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS, VOL 4: VISAPP | 2020年
关键词
Thermal Images; Far Infrared; Dataset; Super-resolution;
D O I
10.5220/0009173601110119
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
This paper proposes a novel CycleGAN architecture for thermal image super-resolution, together with a large dataset consisting of thermal images at different resolutions. The dataset has been acquired using three thermal cameras at different resolutions, which acquire images from the same scenario at the same time. The thermal cameras are mounted in a rig trying to minimize the baseline distance to make easier the registration problem. The proposed architecture is based on ResNet6 as a Generator and PatchGAN as a Discriminator. The novelty on the proposed unsupervised super-resolution training (CycleGAN) is possible due to the existence of aforementioned thermal images-images of the same scenario with different resolutions. The proposed approach is evaluated in the dataset and compared with classical bicubic interpolation. The dataset and the network are available.
引用
收藏
页码:111 / 119
页数:9
相关论文
共 33 条
  • [1] [Anonymous], 2012, LOW COMPLEXITY SINGL
  • [2] Contour Detection and Hierarchical Image Segmentation
    Arbelaez, Pablo
    Maire, Michael
    Fowlkes, Charless
    Malik, Jitendra
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2011, 33 (05) : 898 - 916
  • [3] PairedCycleGAN: Asymmetric Style Transfer for Applying and Removing Makeup
    Chang, Huiwen
    Lu, Jingwan
    Yu, Fisher
    Finkelstein, Adam
    [J]. 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 40 - 48
  • [4] Characterizing Scheduling Delay for Low-latency Data Analytics Workloads
    Chen, Wei
    Pi, Aidi
    Wang, Shaoqi
    Zhou, Xiaobo
    [J]. 2018 32ND IEEE INTERNATIONAL PARALLEL AND DISTRIBUTED PROCESSING SYMPOSIUM (IPDPS), 2018, : 630 - 639
  • [5] Davis JW, 2005, WACV 2005: SEVENTH IEEE WORKSHOP ON APPLICATIONS OF COMPUTER VISION, PROCEEDINGS, P364
  • [6] Accelerating the Super-Resolution Convolutional Neural Network
    Dong, Chao
    Loy, Chen Change
    Tang, Xiaoou
    [J]. COMPUTER VISION - ECCV 2016, PT II, 2016, 9906 : 391 - 407
  • [7] Image Super-Resolution Using Deep Convolutional Networks
    Dong, Chao
    Loy, Chen Change
    He, Kaiming
    Tang, Xiaoou
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2016, 38 (02) : 295 - 307
  • [8] Region-Based Convolutional Networks for Accurate Object Detection and Segmentation
    Girshick, Ross
    Donahue, Jeff
    Darrell, Trevor
    Malik, Jitendra
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2016, 38 (01) : 142 - 158
  • [9] Co-teaching: Robust Training of Deep Neural Networks with Extremely Noisy Labels
    Han, Bo
    Yao, Quanming
    Yu, Xingrui
    Niu, Gang
    Xu, Miao
    Hu, Weihua
    Tsang, Ivor W.
    Sugiyama, Masashi
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 31 (NIPS 2018), 2018, 31
  • [10] CNN-based thermal infrared person detection by domain adaptation
    Herrmann, Christian
    Ruf, Miriam
    Beyerer, Juergen
    [J]. AUTONOMOUS SYSTEMS: SENSORS, VEHICLES, SECURITY, AND THE INTERNET OF EVERYTHING, 2018, 10643