Omnidirectional-Sensor-System-Based Texture Noise Correction in Large-Scale 3D Reconstruction

被引:0
作者
Xie, Wenya [1 ]
Hong, Xiaoping [1 ]
机构
[1] Southern Univ Sci & Technol, Sch Syst Design & Intelligent Mfg, Shenzhen 518055, Peoples R China
关键词
imaging sensor; texture noise correction; frame fusion; voxel hashing; 3D reconstruction; SPECULAR HIGHLIGHT REMOVAL;
D O I
10.3390/s24010078
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
The evolution of cameras and LiDAR has propelled the techniques and applications of three-dimensional (3D) reconstruction. However, due to inherent sensor limitations and environmental interference, the reconstruction process often entails significant texture noise, such as specular highlight, color inconsistency, and object occlusion. Traditional methodologies grapple to mitigate such noise, particularly in large-scale scenes, due to the voluminous data produced by imaging sensors. In response, this paper introduces an omnidirectional-sensor-system-based texture noise correction framework for large-scale scenes, which consists of three parts. Initially, we obtain a colored point cloud with luminance value through LiDAR points and RGB images organization. Next, we apply a voxel hashing algorithm during the geometry reconstruction to accelerate the computation speed and save the computer memory. Finally, we propose the key innovation of our paper, the frame-voting rendering and the neighbor-aided rendering mechanisms, which effectively eliminates the aforementioned texture noise. From the experimental results, the processing rate of one million points per second shows its real-time applicability, and the output figures of texture optimization exhibit a significant reduction in texture noise. These results indicate that our framework has advanced performance in correcting multiple texture noise in large-scale 3D reconstruction.
引用
收藏
页数:16
相关论文
共 37 条
  • [1] Bouguet J-Y, 2004, CAMERA CALIBRATION T
  • [2] Estimating the Laplace-Beltrami Operator by Restricting 3D Functions
    Chuang, Ming
    Luo, Linjie
    Brown, Benedict J.
    Rusinkiewicz, Szymon
    Kazhdan, Michael
    [J]. COMPUTER GRAPHICS FORUM, 2009, 28 (05) : 1475 - 1484
  • [3] Curless B., 1996, Computer Graphics Proceedings. SIGGRAPH '96, P303, DOI 10.1145/237170.237269
  • [4] Specular Highlight Removal for Real-world Images
    Fu, Gang
    Zhang, Qing
    Song, Chengfang
    Lin, Qifeng
    Xiao, Chunxia
    [J]. COMPUTER GRAPHICS FORUM, 2019, 38 (07) : 253 - 263
  • [5] Fusion of Depth Maps with Multiple Scales
    Fuhrmann, Simon
    Goesele, Michael
    [J]. ACM TRANSACTIONS ON GRAPHICS, 2011, 30 (06):
  • [6] Correcting Over-Exposure in Photographs
    Guo, Dong
    Cheng, Yuan
    Zhuo, Shaojie
    Sim, Terence
    [J]. 2010 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2010, : 515 - 521
  • [7] Robust Separation of Reflection from Multiple Images
    Guo, Xiaojie
    Cao, Xiaochun
    Ma, Yi
    [J]. 2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, : 2195 - 2202
  • [8] Enhanced Computer Vision with Microsoft Kinect Sensor: A Review
    Han, Jungong
    Shao, Ling
    Xu, Dong
    Shotton, Jamie
    [J]. IEEE TRANSACTIONS ON CYBERNETICS, 2013, 43 (05) : 1318 - 1334
  • [9] Specular Highlight Removal For Image-Based Dietary Assessment
    He, Y.
    Khanna, N.
    Boushey, C. J.
    Delp, E. J.
    [J]. 2012 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO WORKSHOPS (ICMEW), 2012, : 424 - 428
  • [10] Hore Alain, 2010, Proceedings of the 2010 20th International Conference on Pattern Recognition (ICPR 2010), P2366, DOI 10.1109/ICPR.2010.579