Assembling Convolution Neural Networks for Automatic Viewing Transformation

被引:3
作者
Cai, Haibin [1 ]
Jiang, Lei [1 ]
Liu, Bangli [1 ]
Deng, Yiqi [2 ]
Meng, Qinggang [1 ]
机构
[1] Loughborough Univ, Sch Sci, Dept Comp Sci, Loughborough LE11 3TH, Leics, England
[2] Hunan SukeIntel Co Ltd, Changsha 410013, Peoples R China
基金
英国工程与自然科学研究理事会;
关键词
Three-dimensional displays; Image segmentation; Cameras; Image sensors; Convolution; Neural networks; Transforms; Automatic viewing transform; convolution neural networks; deep learning; UPRIGHT ADJUSTMENT;
D O I
10.1109/TII.2019.2940136
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Images taken under different camera poses are rotated or distorted, which leads to poor perception experiences. This article proposes a new framework to automatically transform the images to the conformable view setting by assembling different convolution neural networks. Specifically, a referential three-dimensional ground plane is first derived from the color image and a novel projection mapping algorithm is developed to achieve automatic viewing transformation. Extensive experimental results demonstrate that the proposed method outperforms the state-of-the-art vanishing points based methods by a large margin in terms of accuracy and robustness.
引用
收藏
页码:587 / 594
页数:8
相关论文
共 27 条
[1]   Rectification of planar targets using line segments [J].
An, Jaehyun ;
Koo, Hyung Il ;
Cho, Nam Ik .
MACHINE VISION AND APPLICATIONS, 2017, 28 (1-2) :91-100
[2]   Image Warps for Artistic Perspective Manipulation [J].
Carroll, Robert ;
Agarwala, Aseem ;
Agrawala, Maneesh .
ACM TRANSACTIONS ON GRAPHICS, 2010, 29 (04)
[3]  
Chaudhury K, 2014, IEEE IMAGE PROC, P3479, DOI 10.1109/ICIP.2014.7025706
[4]  
[陈珺娴 Chen Junxian], 2020, [高分子通报, Polymer Bulletin], P1
[5]   DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs [J].
Chen, Liang-Chieh ;
Papandreou, George ;
Kokkinos, Iasonas ;
Murphy, Kevin ;
Yuille, Alan L. .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (04) :834-848
[6]   RANDOM SAMPLE CONSENSUS - A PARADIGM FOR MODEL-FITTING WITH APPLICATIONS TO IMAGE-ANALYSIS AND AUTOMATED CARTOGRAPHY [J].
FISCHLER, MA ;
BOLLES, RC .
COMMUNICATIONS OF THE ACM, 1981, 24 (06) :381-395
[7]   Deep Ordinal Regression Network for Monocular Depth Estimation [J].
Fu, Huan ;
Gong, Mingming ;
Wang, Chaohui ;
Batmanghelich, Kayhan ;
Tao, Dacheng .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :2002-2011
[8]   Using vanishing points to correct camera rotation in images [J].
Gallagher, AC .
2ND CANADIAN CONFERENCE ON COMPUTER AND ROBOT VISION, PROCEEDINGS, 2005, :460-467
[9]   On Multiscale Self-Similarities Description for Effective Three-Dimensional/Six-Dimensional Motion Trajectory Recognition [J].
Guo, Yao ;
Li, You-Fu ;
Shao, Zhanpeng .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2017, 13 (06) :3017-3026
[10]   USING PERSPECTIVE TRANSFORMATIONS IN SCENE ANALYSIS [J].
HARALICK, RM .
COMPUTER GRAPHICS AND IMAGE PROCESSING, 1980, 13 (03) :191-221