Shape Reconstruction of Object-Level Building From Single Image Based on Implicit Representation Network

被引:2
|
作者
Zhao, Chunhui [1 ,2 ]
Zhang, Chi [1 ,2 ]
Yan, Yiming [1 ,2 ]
Su, Nan [1 ,2 ]
机构
[1] Harbin Engn Univ, Coll Informat & Commun Engn, Harbin 150001, Peoples R China
[2] Harbin Engn Univ, Key Lab Adv Marine Commun & Informat Technol, Minist Ind & Informat Technol, Harbin 150001, Peoples R China
基金
中国国家自然科学基金;
关键词
Buildings; Image reconstruction; Shape; Feature extraction; Three-dimensional displays; Training; Surface reconstruction; implicit representation network (IRNet); remote sensing images; shape reconstruction;
D O I
10.1109/LGRS.2021.3126767
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Three-dimensional shape reconstruction of the object-level building (SROLB) is one of the essential issues in remote sensing. Especially, utilizing the single remote sensing image (SRSI) to perform shape reconstruction can offer better scalability and transferability, in terms of simplifying input data. Recently, the methods of shape reconstruction based on neural networks have been widely studied. However, most of them generate models with irregular surfaces and few details. Besides, complex background in SRSI leads to a poor generalization of networks and reduces the quality of generated models. To solve the above problems, an implicit representation network (IRNet) is proposed in this letter. IRNet is composed of two parts: 3-D space decoding and feature extraction. First, the signed distance function (SDF) is employed to fit implicit representation better in the decoding module. Moreover, a multistage weight loss function is designed, making the network generating models with flatter surfaces and more details. Then, a channel attention (CA) module is added to the feature extraction network. It reduces the interference of the background in the image effectively and improves the generalization of the network. Finally, our method generates mesh models of the individual buildings. The experimental results show that a better accuracy can be obtained compared with state-of-the-art methods.
引用
收藏
页数:5
相关论文
共 46 条
  • [1] PaMIR: Parametric Model-Conditioned Implicit Representation for Image-Based Human Reconstruction
    Zheng, Zerong
    Yu, Tao
    Liu, Yebin
    Dai, Qionghai
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (06) : 3170 - 3184
  • [2] Oriented and Directional Chamfer Distance Losses for 3D Object Reconstruction From a Single Image
    Lu, Jinxiao
    Li, Zhizhen
    Bai, Jiquan
    Yu, Qian
    IEEE ACCESS, 2022, 10 : 61631 - 61638
  • [3] Towards Accurate Reconstruction of 3D Scene Shape From A Single Monocular Image
    Yin, Wei
    Zhang, Jianming
    Wang, Oliver
    Niklaus, Simon
    Chen, Simon
    Liu, Yifan
    Shen, Chunhua
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (05) : 6480 - 6494
  • [4] ShapeGraFormer: GraFormer-Based Network for Hand-Object Reconstruction From a Single Depth Map
    Aboukhadra, Ahmed Tawfik
    Malik, Jameel
    Robertini, Nadia
    Elhayek, Ahmed
    Stricker, Didier
    IEEE ACCESS, 2024, 12 : 124021 - 124031
  • [5] Image-to-Graph Convolutional Network for Deformable Shape Reconstruction from a Single Projection Image
    Nakao, Megumi
    Tong, Fei
    Nakamura, Mitsuhiro
    Matsuda, Tetsuya
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2021, PT IV, 2021, 12904 : 259 - 268
  • [6] SHAPE RECONSTRUCTION FROM A SINGLE THERMAL IMAGE
    BARKER, E
    MALDAGUE, X
    LAURENDEAU, D
    OPTICAL ENGINEERING, 1995, 34 (01) : 154 - 159
  • [7] Multi-person Implicit Reconstruction from a Single Image
    Mustafa, Armin
    Caliskan, Akin
    Agapito, Lourdes
    Hilton, Adrian
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 14469 - 14478
  • [8] 3-D Brain Reconstruction by Hierarchical Shape-Perception Network From a Single Incomplete Image
    Hu, Bowen
    Zhan, Choujun
    Tang, Buzhou
    Wang, Bingchuan
    Lei, Baiying
    Wang, Shu-Qiang
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (10) : 13271 - 13283
  • [9] Learning Pose Controllable Human Reconstruction With Dynamic Implicit Fields From a Single Image
    Li, Jituo
    Liu, Xinqi
    Lu, Guodong
    IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2025, 31 (02) : 1389 - 1401
  • [10] Image-based object reconstruction using run-length representation
    Hwang, Sung Soo
    Kim, Hee-Dong
    Jang, Tae Young
    Yoo, Jisung
    Kim, Sujung
    Paeng, Kyunghyun
    Kim, Seong Dae
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2017, 51 : 1 - 12