Real-Scale 3-D Reconstruction With Monocular Zoom Technology

被引:0
|
作者
Song, Jinao [1 ]
Li, Jie [1 ]
Fan, Hao [1 ]
Qi, Lin [1 ]
Zhang, Shu [1 ]
Chen, Yong [1 ]
Dong, Junyu [1 ]
机构
[1] Ocean Univ China, Dept Informat Sci & Technol, Qingdao 266000, Peoples R China
基金
中国国家自然科学基金;
关键词
Three-dimensional displays; Accuracy; Structure from motion; Design methodology; Cameras; Image restoration; Image reconstruction; Monocular zooming; optical flow; real-scale 3-D reconstruction;
D O I
10.1109/TIM.2024.3497052
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
We propose a method that is able to use the monocular zoom technology for real-scale 3-D reconstruction of the scene. To reconstruct the scene, we take a sequence of zoomed-in and zoomed-out figures. First, we can estimate zoomed-in camera parameters using the known zoomed-out camera parameters, which avoids calibrating the camera parameters twice. Then, we use the structure from motion (SfM) method (COLMAP) to reconstruct free-scale translations among these figures. After that, as we have pairs of zoom frames in the same scene, we can calculate the true scale of the scene by comparing the ratio between the free-scale translation of a pair of zoom frames and the difference in zoomed-out and the zoomed-in focal length. Finally, we use RAFT-stereo to compute the depth of the scene. In detail, we select two adjacent figures taken at the same focal length, make a stereo correction for them, and remove the nonco-vision area of the corrected images. This way, we obtain a more accurate matching of these images and then get a dense real-scale 3-D reconstruction. Experimental results have demonstrated that our method achieves good performance on monocular 3-D reconstruction with the real scale.
引用
收藏
页数:8
相关论文
共 50 条
  • [21] Enhancing Monocular 3-D Object Detection Through Data Augmentation Strategies
    Jia, Yisong
    Wang, Jue
    Pan, Huihui
    Sun, Weichao
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2024, 73 : 1 - 11
  • [22] 3D3M: 3D Modulated Morphable Model for Monocular Face Reconstruction
    Li, Yong
    Hao, Qiang
    Hu, Jianguo
    Pan, Xinmiao
    Li, Zechao
    Cui, Zhen
    IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 6642 - 6652
  • [23] Pursuing 3-D Scene Structures With Optical Satellite Images From Affine Reconstruction to Euclidean Reconstruction
    Wang, Pinhe
    Shi, Limin
    Chen, Bao
    Hu, Zhanyi
    Qiao, Jianzhong
    Dong, Qiulei
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [24] A Reinforcement Learning Approach for Real-Time Articulated Surgical Instrument 3-D Pose Reconstruction
    Fan, Ke
    Chen, Ziyang
    Liu, Qiaoling
    Ferrigno, Giancarlo
    De Momi, Elena
    IEEE TRANSACTIONS ON MEDICAL ROBOTICS AND BIONICS, 2024, 6 (04): : 1458 - 1467
  • [25] A Review on Viewpoints and Path Planning for UAV-Based 3-D Reconstruction
    Maboudi, Mehdi
    Homaei, MohammadReza
    Song, Soohwan
    Malihi, Shirin
    Saadatseresht, Mohammad
    Gerke, Markus
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2023, 16 : 5026 - 5048
  • [26] Application of Forward-Scan Sonar Stereo for 3-D Scene Reconstruction
    Negandaripour, Shahriar
    IEEE JOURNAL OF OCEANIC ENGINEERING, 2020, 45 (02) : 547 - 562
  • [27] NHK Meta Studio: A Compact Volumetric TV Studio for 3-D Reconstruction
    Morioka, Hirofumi
    Misu, Toshie
    Suginoshita, Taichi
    Mitsumine, Hideki
    IEEE TRANSACTIONS ON BROADCASTING, 2023, 69 (01) : 2 - 9
  • [28] Real-scale 3D models of the scoliotic spine from biplanar radiography without calibration objects
    Moura, Daniel C.
    Barbosa, Jorge G.
    COMPUTERIZED MEDICAL IMAGING AND GRAPHICS, 2014, 38 (07) : 580 - 585
  • [29] Chasing the Tail in Monocular 3D Human Reconstruction With Prototype Memory
    Rong, Yu
    Liu, Ziwei
    Loy, Chen Change
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 2907 - 2919
  • [30] Accurate 3-D Reconstruction Under IoT Environments and Its Applications to Augmented Reality
    Cao, Mingwei
    Zheng, Liping
    Jia, Wei
    Lu, Huimin
    Liu, Xiaoping
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2021, 17 (03) : 2090 - 2100