A NeRF-Based Color Consistency Correction Method for Remote Sensing Images

被引:2
作者
Zuo, Zongcheng [1 ]
Li, Yuanxiang [1 ]
Zhang, Tongtong [1 ]
Mo, Fan [2 ]
机构
[1] Shanghai Jiao Tong Univ, Sch Aeronaut & Astronaut, Shanghai 200240, Peoples R China
[2] Minist Nat Resources, Land Satellite Remote Sensing Applicat Ctr, Beijing 100048, Peoples R China
基金
中国国家自然科学基金;
关键词
Lighting; Image color analysis; Remote sensing; Reflectivity; Training; Rendering (computer graphics); Image reconstruction; Color consistency; feature fusion; image mosaicking; multiple-view images; neural radiance field (NeRF); REFLECTANCE; MOSAICKING; FRAMEWORK;
D O I
10.1109/JSTARS.2024.3374808
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Remote sensing images are prone to significant variations in photometry due to changing seasons, illumination, and atmospheric conditions. These variations often result in visible stitching seams at the edges of mosaic images, which can impact the visual quality and interpretation of the data. To address color inconsistencies in remote sensing images, conventional methods rely on absolute radiation correction and relative radiation normalization. However, these approaches may not be effective in handling complex variations and producing visually pleasing outcomes. This article introduces a novel approach based on neural radiance fields (NeRFs) for correcting color inconsistencies in multiview images. Our method leverages implicit expressions and reillumination of the feature space to capture the intrinsic radiance and reflectance properties of the scene. By intricately weaving image features together, we generate a fusion image that seamlessly integrates color information from multiple views, resulting in improved color consistency and reduced stitching seams. To evaluate the effectiveness of our approach, we conducted experiments using satellite and unmanned aerial vehicle images with significant variations in range and time. The experimental results demonstrate that our NeRF-based method produces synthesized images with exceptional visual effects and smooth color transitions at the edges. The fusion images exhibit enhanced color consistency, effectively reducing visible stitching seams and elevating the overall image quality.
引用
收藏
页码:6805 / 6817
页数:13
相关论文
共 47 条
[1]   Shape, Illumination, and Reflectance from Shading [J].
Barron, Jonathan T. ;
Malik, Jitendra .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2015, 37 (08) :1670-1687
[2]   Lambertian reflectance and linear subspaces [J].
Basri, R ;
Jacobs, DW .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2003, 25 (02) :218-233
[3]  
Berthold K P H., 1974, Com- put. Graph. Image Process., V3, P277, DOI [DOI 10.1016/0146-664X(74)90022-7, DOI 10.1016/0146-664X(74)90011-2]
[4]   Deep Relightable Appearance Models for Animatable Faces [J].
Bi, Sai ;
Lombardi, Stephen ;
Saito, Shunsuke ;
Simon, Tomas ;
Wei, Shih-En ;
Mcphail, Kevyn ;
Ramamoorthi, Ravi ;
Sheikh, Yaser ;
Saragih, Jason .
ACM TRANSACTIONS ON GRAPHICS, 2021, 40 (04)
[5]   NeRD: Neural Reflectance Decomposition from Image Collections [J].
Boss, Mark ;
Braun, Raphael ;
Jampani, Varun ;
Barron, Jonathan T. ;
Liu, Ce ;
Lensch, Hendrik P. A. .
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, :12664-12674
[6]   Automatic panoramic image stitching using invariant features [J].
Brown, Matthew ;
Lowe, David G. .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2007, 74 (01) :59-73
[7]   Automatic radiometric normalization of multitemporal satellite imagery [J].
Canty, MJ ;
Nielsen, AA ;
Schmidt, M .
REMOTE SENSING OF ENVIRONMENT, 2004, 91 (3-4) :441-451
[8]   MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereo [J].
Chen, Anpei ;
Xu, Zexiang ;
Zhao, Fuqiang ;
Zhang, Xiaoshuai ;
Xiang, Fanbo ;
Yu, Jingyi ;
Su, Hao .
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, :14104-14113
[9]   Generalized Content-Preserving Warp: Direct Photometric Alignment Beyond Color Consistency [J].
Chen, Kai ;
Tu, Jingmin ;
Yao, Jian ;
Li, Jie .
IEEE ACCESS, 2018, 6 :69835-69849
[10]   Multiview Intrinsic Images of Outdoors Scenes with an Application to Relighting [J].
Duchene, Sylvain ;
Riant, Clement ;
Chaurasia, Gaurav ;
Moreno, Jorge Lopez ;
Laffont, Pierre-Yves ;
Popov, Stefan ;
Bousseau, Adrien ;
Drettakis, George .
ACM TRANSACTIONS ON GRAPHICS, 2015, 34 (05)