Shape Reconstruction of Object-Level Building From Single Image Based on Implicit Representation Network

被引:2
|
作者
Zhao, Chunhui [1 ,2 ]
Zhang, Chi [1 ,2 ]
Yan, Yiming [1 ,2 ]
Su, Nan [1 ,2 ]
机构
[1] Harbin Engn Univ, Coll Informat & Commun Engn, Harbin 150001, Peoples R China
[2] Harbin Engn Univ, Key Lab Adv Marine Commun & Informat Technol, Minist Ind & Informat Technol, Harbin 150001, Peoples R China
基金
中国国家自然科学基金;
关键词
Buildings; Image reconstruction; Shape; Feature extraction; Three-dimensional displays; Training; Surface reconstruction; implicit representation network (IRNet); remote sensing images; shape reconstruction;
D O I
10.1109/LGRS.2021.3126767
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Three-dimensional shape reconstruction of the object-level building (SROLB) is one of the essential issues in remote sensing. Especially, utilizing the single remote sensing image (SRSI) to perform shape reconstruction can offer better scalability and transferability, in terms of simplifying input data. Recently, the methods of shape reconstruction based on neural networks have been widely studied. However, most of them generate models with irregular surfaces and few details. Besides, complex background in SRSI leads to a poor generalization of networks and reduces the quality of generated models. To solve the above problems, an implicit representation network (IRNet) is proposed in this letter. IRNet is composed of two parts: 3-D space decoding and feature extraction. First, the signed distance function (SDF) is employed to fit implicit representation better in the decoding module. Moreover, a multistage weight loss function is designed, making the network generating models with flatter surfaces and more details. Then, a channel attention (CA) module is added to the feature extraction network. It reduces the interference of the background in the image effectively and improves the generalization of the network. Finally, our method generates mesh models of the individual buildings. The experimental results show that a better accuracy can be obtained compared with state-of-the-art methods.
引用
收藏
页数:5
相关论文
共 46 条
  • [21] Learning image representation from image reconstruction for a content-based medical image retrieval
    Rohini Pinapatruni
    C. Shoba Bindu
    Signal, Image and Video Processing, 2020, 14 : 1319 - 1326
  • [22] Single image 3D object reconstruction based on deep learning: A review
    Fu, Kui
    Peng, Jiansheng
    He, Qiwen
    Zhang, Hanxiao
    MULTIMEDIA TOOLS AND APPLICATIONS, 2021, 80 (01) : 463 - 498
  • [23] Detecting Object Surface Keypoints From a Single RGB Image via Deep Learning Network for 6-DoF Pose Estimation
    Aing, Lee
    Lie, Wen-Nung
    IEEE ACCESS, 2021, 9 : 77729 - 77741
  • [24] Building 3D Object Reconstruction System Based on Color-Depth Image Sequences
    Ngoc Quoc Ly
    Tai Cong Tan Vu
    Thanh Quoc Tac
    RECENT DEVELOPMENTS IN INTELLIGENT INFORMATION AND DATABASE SYSTEMS, 2016, 642 : 323 - 333
  • [25] Trilateral convolutional neural network for 3D shape reconstruction of objects from a single depth view
    Rivera, Patricio
    Anazco, Edwin Valarezo
    Choi, Mun-Taek
    Kim, Tae-Seong
    IET IMAGE PROCESSING, 2019, 13 (13) : 2457 - 2466
  • [26] 3D colored object reconstruction from a single view image through diffusion
    Li, Bo
    Wei, Xiaolin
    Liu, Bin
    Wang, Weiming
    He, Zhi-Fen
    Lai, Yu-Kun
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 252
  • [27] Three-Dimensional Face Reconstruction From a Single Image by a Coupled RBF Network
    Song, Mingli
    Tao, Dacheng
    Huang, Xiaoqin
    Chen, Chun
    Bu, Jiajun
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2012, 21 (05) : 2887 - 2897
  • [28] Single-pixel image reconstruction based on block compressive sensing and convolutional neural network
    Lau, Stephen L. H.
    Lim, Jiayou
    Chong, Edwin K. P.
    Wang, Xin
    INTERNATIONAL JOURNAL OF HYDROMECHATRONICS, 2023, 6 (03) : 258 - 273
  • [29] Single-image Object Classification Based on Illuminette Construction from Shadow Imaging
    Collins, Lyle
    Robles-Kelly, Antonio
    2021 INTERNATIONAL CONFERENCE ON DIGITAL IMAGE COMPUTING: TECHNIQUES AND APPLICATIONS (DICTA 2021), 2021, : 106 - 113
  • [30] Multi-Level Noise Sampling From Single Image for Low-Dose Tomography Reconstruction
    Wu, Weiwen
    Long, Yifei
    Gao, Zhifan
    Yang, Guang
    Cheng, Fangxiao
    Zhang, Jianjia
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2025, 29 (02) : 1256 - 1268