Shape Reconstruction of Object-Level Building From Single Image Based on Implicit Representation Network

被引:2
|
作者
Zhao, Chunhui [1 ,2 ]
Zhang, Chi [1 ,2 ]
Yan, Yiming [1 ,2 ]
Su, Nan [1 ,2 ]
机构
[1] Harbin Engn Univ, Coll Informat & Commun Engn, Harbin 150001, Peoples R China
[2] Harbin Engn Univ, Key Lab Adv Marine Commun & Informat Technol, Minist Ind & Informat Technol, Harbin 150001, Peoples R China
基金
中国国家自然科学基金;
关键词
Buildings; Image reconstruction; Shape; Feature extraction; Three-dimensional displays; Training; Surface reconstruction; implicit representation network (IRNet); remote sensing images; shape reconstruction;
D O I
10.1109/LGRS.2021.3126767
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Three-dimensional shape reconstruction of the object-level building (SROLB) is one of the essential issues in remote sensing. Especially, utilizing the single remote sensing image (SRSI) to perform shape reconstruction can offer better scalability and transferability, in terms of simplifying input data. Recently, the methods of shape reconstruction based on neural networks have been widely studied. However, most of them generate models with irregular surfaces and few details. Besides, complex background in SRSI leads to a poor generalization of networks and reduces the quality of generated models. To solve the above problems, an implicit representation network (IRNet) is proposed in this letter. IRNet is composed of two parts: 3-D space decoding and feature extraction. First, the signed distance function (SDF) is employed to fit implicit representation better in the decoding module. Moreover, a multistage weight loss function is designed, making the network generating models with flatter surfaces and more details. Then, a channel attention (CA) module is added to the feature extraction network. It reduces the interference of the background in the image effectively and improves the generalization of the network. Finally, our method generates mesh models of the individual buildings. The experimental results show that a better accuracy can be obtained compared with state-of-the-art methods.
引用
收藏
页数:5
相关论文
共 46 条
  • [31] Single Exposure High Dynamic Range Image Reconstruction Based on Deep Dual-Branch Network
    Ye, Nianjin
    Huo, Yongqing
    Liu, Shuaicheng
    Li, Hanlin
    IEEE ACCESS, 2021, 9 : 9610 - 9624
  • [32] Age and gender-based human face reconstruction from single frontal image
    Ferkova, Zuzana
    Urbanova, Petra
    Cerny, Dominik
    Zuzi, Marek
    Matula, Petr
    MULTIMEDIA TOOLS AND APPLICATIONS, 2020, 79 (5-6) : 3217 - 3242
  • [33] PAA: Perception based Anti-Aliasing for High Quality Transformed Image Reconstruction from Single Image
    Sankaralingam, M.
    Das, Apurba
    PERCEPTION AND MACHINE INTELLIGENCE, 2015, 2015, : 37 - 45
  • [34] HIGH-RESOLUTION SURFACE RECONSTRUCTION BASED ON MULTI-LEVEL IMPLICIT SURFACE FROM MULTIPLE RANGE IMAGES
    Noguchi, Shohei
    Watanabe, Yoshihiro
    Ishikawa, Masatoshi
    2013 20TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP 2013), 2013, : 2140 - 2144
  • [35] Object image reconstruction: method for reconstructing images from digital off-axis holograms using a generative adversarial network
    Kiriy, Semen A.
    Svistunov, Andrey S.
    Rymov, Dmitry A.
    Starikov, Rostislav S.
    Shifrina, Anna V.
    Cheremkhin, Pavel A.
    MEASUREMENT TECHNIQUES, 2024, 67 (04) : 282 - 290
  • [36] An Image Super-Resolution Reconstruction Method with Single Frame Character Based on Wavelet Neural Network in Internet of Things
    Guo, Ling-li
    Wozniak, Marcin
    MOBILE NETWORKS & APPLICATIONS, 2021, 26 (01): : 390 - 403
  • [37] An Image Super-Resolution Reconstruction Method with Single Frame Character Based on Wavelet Neural Network in Internet of Things
    Ling-li Guo
    Marcin Woźniak
    Mobile Networks and Applications, 2021, 26 : 390 - 403
  • [38] Constraint-Free Natural Image Reconstruction From fMRI Signals Based on Convolutional Neural Network
    Zhang, Chi
    Qiao, Kai
    Wang, Linyuan
    Tong, Li
    Zeng, Ying
    Yan, Bin
    FRONTIERS IN HUMAN NEUROSCIENCE, 2018, 12
  • [39] Phenotypic Parameters Estimation of Plants Using Deep Learning-Based 3-D Reconstruction From Single RGB Image
    Zhao, Genping
    Cai, Weitao
    Wang, Zhuowei
    Wu, Heng
    Peng, Yeping
    Cheng, Lianglun
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [40] Unsupervised Style-based Explicit 3D Face Reconstruction from Single Image
    Yu, Heng
    Milacski, Zoltan A.
    Jeni, Laszlo A.
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW, 2023, : 719 - 729