PLNet: Plane and Line Priors for Unsupervised Indoor Depth Estimation

被引:12
作者
Jiang, Hualie [1 ,3 ]
Ding, Laiyan [1 ,2 ]
Hu, Junjie [2 ]
Huang, Rui [1 ,2 ]
机构
[1] Chinese Univ Hong Kong, Sch Sci & Engn, Shenzhen, Peoples R China
[2] Shenzhen Inst Artificial Intelligence & Robot Soc, Shenzhen, Guangdong, Peoples R China
[3] Chinese Acad Sci, Shenzhen Inst Adv Technol, Beijing, Peoples R China
来源
2021 INTERNATIONAL CONFERENCE ON 3D VISION (3DV 2021) | 2021年
关键词
REGRESSION; VISION;
D O I
10.1109/3DV53792.2021.00083
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Unsupervised learning of depth from indoor monocular videos is challenging as the artificial environment contains many textureless regions. Fortunately, the indoor scenes are full of specific structures, such as planes and lines, which should help guide unsupervised depth learning. This paper proposes PLNet that leverages the plane and line priors to enhance the depth estimation. We first represent the scene geometry using local planar coefficients and impose the smoothness constraint on the representation. Moreover, we enforce the planar and linear consistency by randomly selecting some sets of points that are probably coplanar or collinear to construct simple and effective consistency losses. To verify the proposed method's effectiveness, we further propose to evaluate the flatness and straightness of the predicted point cloud on the reliable planar and linear regions. The regularity of these regions indicates quality indoor reconstruction. Experiments on NYU Depth V2 and ScanNet show that PLNet outperforms existing methods. The code is available at https://github.com/HalleyJiang/PLNet.
引用
收藏
页码:741 / 750
页数:10
相关论文
共 60 条
  • [1] Principal component analysis
    Abdi, Herve
    Williams, Lynne J.
    [J]. WILEY INTERDISCIPLINARY REVIEWS-COMPUTATIONAL STATISTICS, 2010, 2 (04): : 433 - 459
  • [2] [Anonymous], 2011, ISPRS WORKSH LAS SCA
  • [3] [Anonymous], 2006, Multiple view geometry in computer vision
  • [4] Bian J., 2019, NeurIPS, V32, P35
  • [5] Bian Jia-Wang, 2020, UNSUPERVISED DEPTH L, V1, P2
  • [6] Casser V, 2019, AAAI CONF ARTIF INTE, P8001
  • [7] Concha A, 2015, IEEE INT C INT ROBOT, P5686, DOI 10.1109/IROS.2015.7354184
  • [8] Concha A, 2014, IEEE INT CONF ROBOT, P365, DOI 10.1109/ICRA.2014.6906883
  • [9] ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenes
    Dai, Angela
    Chang, Angel X.
    Savva, Manolis
    Halber, Maciej
    Funkhouser, Thomas
    Niessner, Matthias
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 2432 - 2443
  • [10] Deng J, 2009, PROC CVPR IEEE, P248, DOI 10.1109/CVPRW.2009.5206848