Real-Scale 3-D Reconstruction With Monocular Zoom Technology

被引:0
|
作者
Song, Jinao [1 ]
Li, Jie [1 ]
Fan, Hao [1 ]
Qi, Lin [1 ]
Zhang, Shu [1 ]
Chen, Yong [1 ]
Dong, Junyu [1 ]
机构
[1] Ocean Univ China, Dept Informat Sci & Technol, Qingdao 266000, Peoples R China
基金
中国国家自然科学基金;
关键词
Three-dimensional displays; Accuracy; Structure from motion; Design methodology; Cameras; Image restoration; Image reconstruction; Monocular zooming; optical flow; real-scale 3-D reconstruction;
D O I
10.1109/TIM.2024.3497052
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
We propose a method that is able to use the monocular zoom technology for real-scale 3-D reconstruction of the scene. To reconstruct the scene, we take a sequence of zoomed-in and zoomed-out figures. First, we can estimate zoomed-in camera parameters using the known zoomed-out camera parameters, which avoids calibrating the camera parameters twice. Then, we use the structure from motion (SfM) method (COLMAP) to reconstruct free-scale translations among these figures. After that, as we have pairs of zoom frames in the same scene, we can calculate the true scale of the scene by comparing the ratio between the free-scale translation of a pair of zoom frames and the difference in zoomed-out and the zoomed-in focal length. Finally, we use RAFT-stereo to compute the depth of the scene. In detail, we select two adjacent figures taken at the same focal length, make a stereo correction for them, and remove the nonco-vision area of the corrected images. This way, we obtain a more accurate matching of these images and then get a dense real-scale 3-D reconstruction. Experimental results have demonstrated that our method achieves good performance on monocular 3-D reconstruction with the real scale.
引用
收藏
页数:8
相关论文
共 50 条
  • [41] Joint 3-D Human Reconstruction and Hybrid Pose Self-Supervision for Action Recognition
    Quan, Wei
    Wang, Hexin
    Li, Luwei
    Qiu, Yuxuan
    Shi, Zhiping
    Jiang, Na
    IEEE INTERNET OF THINGS JOURNAL, 2025, 12 (07): : 8470 - 8483
  • [42] A Novel Visual-Based 3-D Reconstruction Method for Underwater Dry Welding Robots
    Chi, Peng
    Wang, Zhenmin
    Liao, Haipeng
    Li, Ting
    Wu, Xiangmiao
    Zhang, Qin
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2025, 74
  • [43] 3-D Reconstruction of Bubble Flow Field Based on the Method of Multivision by Rough-Precise Location Algebraic Reconstruction Technique
    Wang, Hong-Yi
    Shi, Ya-Fang
    Zhu, Xin-Jun
    Song, Li-Mei
    Dong, Feng
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2022, 71
  • [44] Real-Time Reconstruction for 3-D CT Applied to Large Objects of Cultural Heritage
    Brancaccio, R.
    Bettuzzi, M.
    Casali, F.
    Morigi, M. P.
    Levi, G.
    Gallo, A.
    Marchetti, G.
    Schneberk, D.
    IEEE TRANSACTIONS ON NUCLEAR SCIENCE, 2011, 58 (04) : 1864 - 1871
  • [45] Lightweight 3-D Convolutional Occupancy Networks for Virtual Object Reconstruction
    Tonti, Claudia Melis
    Papa, Lorenzo
    Amerini, Irene
    IEEE COMPUTER GRAPHICS AND APPLICATIONS, 2024, 44 (02) : 23 - 36
  • [46] Real-Time Reinforcement Learning for Optimal Viewpoint Selection in Monocular 3D Human Pose Estimation
    Lee, Sanghyeon
    Hwang, Yoonho
    Lee, Jong Taek
    IEEE ACCESS, 2024, 12 : 191020 - 191029
  • [47] Towards Accurate Reconstruction of 3D Scene Shape From A Single Monocular Image
    Yin, Wei
    Zhang, Jianming
    Wang, Oliver
    Niklaus, Simon
    Chen, Simon
    Liu, Yifan
    Shen, Chunhua
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (05) : 6480 - 6494
  • [48] Event-Driven Fringe Projection Structured Light 3-D Reconstruction Based on TimeFrequency Analysis
    Li, Yuhui
    Jiang, Heng
    Xu, Chen
    Liu, Lilin
    IEEE SENSORS JOURNAL, 2024, 24 (04) : 5097 - 5106
  • [49] A Robust Multispectral Point Cloud Generation Method Based on 3-D Reconstruction From Multispectral Images
    Wang, Chen
    Gu, Yanfeng
    Li, Xian
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [50] Accurate and Robust Roadside 3-D Object Detection Based on Height-Aware Scene Reconstruction
    Chen, Yaqing
    Wang, Huaming
    IEEE SENSORS JOURNAL, 2024, 24 (19) : 30643 - 30653