OmniSCV: An Omnidirectional Synthetic Image Generator for Computer Vision

被引:8
作者
Berenguel-Baeta, Bruno [1 ]
Bermudez-Cameo, Jesus [1 ]
Guerrero, Jose J. [1 ]
机构
[1] Univ Zaragoza, Inst Invest Ingn Aragon, Zaragoza 50018, Spain
关键词
computer vision; omnidirectional cameras; virtual environment; deep learning; non-central systems; image generator; semantic label; CAMERAS; CALIBRATION; SLAM;
D O I
10.3390/s20072066
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Omnidirectional and 360 degrees images are becoming widespread in industry and in consumer society, causing omnidirectional computer vision to gain attention. Their wide field of view allows the gathering of a great amount of information about the environment from only an image. However, the distortion of these images requires the development of specific algorithms for their treatment and interpretation. Moreover, a high number of images is essential for the correct training of computer vision algorithms based on learning. In this paper, we present a tool for generating datasets of omnidirectional images with semantic and depth information. These images are synthesized from a set of captures that are acquired in a realistic virtual environment for Unreal Engine 4 through an interface plugin. We gather a variety of well-known projection models such as equirectangular and cylindrical panoramas, different fish-eye lenses, catadioptric systems, and empiric models. Furthermore, we include in our tool photorealistic non-central-projection systems as non-central panoramas and non-central catadioptric systems. As far as we know, this is the first reported tool for generating photorealistic non-central images in the literature. Moreover, since the omnidirectional images are made virtually, we provide pixel-wise information about semantics and depth as well as perfect knowledge of the calibration parameters of the cameras. This allows the creation of ground-truth information with pixel precision for training learning algorithms and testing 3D vision approaches. To validate the proposed tool, different computer vision algorithms are tested as line extractions from dioptric and catadioptric central images, 3D Layout recovery and SLAM using equirectangular panoramas, and 3D reconstruction from non-central panoramas.
引用
收藏
页数:25
相关论文
共 42 条
  • [1] Single Image Calibration of Multi-Axial Imaging Systems
    Agrawal, Amit
    Ramalingam, Srikumar
    [J]. 2013 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2013, : 1399 - 1406
  • [2] Angus M, 2018, IEEE INT C INTELL TR, P985, DOI 10.1109/ITSC.2018.8569519
  • [3] Armeni Iro, 2017, arXiv Preprint, DOI DOI 10.48550/ARXIV.1702.01105
  • [4] SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation
    Badrinarayanan, Vijay
    Kendall, Alex
    Cipolla, Roberto
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (12) : 2481 - 2495
  • [5] A theory of single-viewpoint catadioptric image formation
    Baker, S
    Nayar, SK
    [J]. INTERNATIONAL JOURNAL OF COMPUTER VISION, 1999, 35 (02) : 175 - 196
  • [6] Automatic Line Extraction in Uncalibrated Omnidirectional Cameras with Revolution Symmetry
    Bermudez-Cameo, J.
    Lopez-Nicolas, G.
    Guerrero, J. J.
    [J]. INTERNATIONAL JOURNAL OF COMPUTER VISION, 2015, 114 (01) : 16 - 37
  • [7] Bermudez-Cameo J, 2016, LINE RECONSTRUCTION
  • [8] Fitting line projections in non-central catadioptric cameras with revolution symmetry
    Bermudez-Cameo, Jesus
    Lopez-Nicolas, Gonzalo
    Guerrero, Jose J.
    [J]. COMPUTER VISION AND IMAGE UNDERSTANDING, 2018, 167 : 134 - 152
  • [9] Exploiting line metric reconstruction from non-central circular panoramas
    Bermudez-Cameo, Jesus
    Saurer, Olivier
    Lopez-Nicolas, Gonzalo
    Guerrero, Jose. J.
    Pollefeys, Marc
    [J]. PATTERN RECOGNITION LETTERS, 2017, 94 : 30 - 37
  • [10] Cordts M., 2015, PROC CVPR WORKSHOP F, V2