Interactive geometry editing of Neural Radiance Fields

被引:2
|
作者
Li, Shaoxu [1 ]
Pan, Ye [1 ]
机构
[1] Shanghai Jiao Tong Univ, John Hopcroft Ctr Comp Sci, Shanghai, Peoples R China
基金
中国国家自然科学基金;
关键词
Image editing; Image-based rendering; Multi-view images; Interaction techniques;
D O I
10.1016/j.displa.2024.102810
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Neural Radiance Fields (NeRF) have recently emerged as a promising approach for synthesizing highly realistic images from 3D scenes. This technology has shown impressive results in capturing intricate details and producing photorealistic renderings. However, one of the limitations of traditional NeRF approaches is the difficulty in editing and manipulating the geometry of the scene once it has been captured. This restriction hinders creative freedom and practical applicability. In this paper, we propose a method that enables interactive geometry editing for neural radiance fields manipulation. We use two proxy cages (inner cage and outer cage) to edit a scene. The inner cage defines the operation target, and the outer cage defines the adjustment space. Various operations apply to the two cages. After cage selection, operations on the inner cage lead to the desired transformation of the inner cage and adjustment of the outer cage. Users can edit the scene with translation, rotation, scaling, or combinations. The operations on the corners and edges of the cage are also supported. Our method does not need any explicit 3D geometry representations. The interactive geometry editing applies directly to the implicit neural radiance fields. Extensive experimental results demonstrate the effectiveness of our approach.
引用
收藏
页数:9
相关论文
共 50 条
  • [1] NeRFshop: Interactive Editing of Neural Radiance Fields
    Jambon, Clement
    Kerbl, Bernhard
    Kopanas, Georgios
    Diolatzis, Stavros
    Leimkuhler, Thomas
    Drettakis, George
    PROCEEDINGS OF THE ACM ON COMPUTER GRAPHICS AND INTERACTIVE TECHNIQUES, 2023, 6 (01)
  • [2] NeRF-Editing: Geometry Editing of Neural Radiance Fields
    Yuan, Yu-Jie
    Sun, Yang-Tian
    Lai, Yu-Kun
    Ma, Yuewen
    Jia, Rongfei
    Gao, Lin
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 18332 - 18343
  • [3] FENeRF: Face Editing in Neural Radiance Fields
    Sun, Jingxiang
    Wang, Xuan
    Zhang, Yong
    Li, Xiaoyu
    Zhang, Qi
    Liu, Yebin
    Wang, Jue
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 7662 - 7672
  • [4] Seal-3D: Interactive Pixel-Level Editing for Neural Radiance Fields
    Wang, Xiangyu
    Zhu, Jingsen
    Ye, Qi
    Huo, Yuchi
    Ran, Yunlong
    Zhong, Zhihua
    Chen, Jiming
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 17637 - 17647
  • [5] NeRFFaceEditing: Disentangled Face Editing in Neural Radiance Fields
    Jiang, Kaiwen
    Chen, Shu-Yu
    Liu, Feng-Lin
    Fu, Hongbo
    Gao, Lin
    PROCEEDINGS SIGGRAPH ASIA 2022, 2022,
  • [6] Neural Impostor: Editing Neural Radiance Fields with Explicit Shape Manipulation
    Liu, Ruiyang
    Xiang, Jinxu
    Zhao, Bowen
    Zhang, Ran
    Yu, Jingyi
    Zheng, Changxi
    COMPUTER GRAPHICS FORUM, 2023, 42 (07)
  • [7] Editing Conditional Radiance Fields
    Liu, Steven
    Zhang, Xiuming
    Zhang, Zhoutong
    Zhang, Richard
    Zhu, Jun-Yan
    Russell, Bryan
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 5753 - 5763
  • [8] EditableNeRF: Editing Topologically Varying Neural Radiance Fields by Key Points
    Zheng, Chengwei
    Lin, Wenbin
    Xu, Feng
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 8317 - 8327
  • [9] EditableNeRF: Editing Topologically Varying Neural Radiance Fields by Key Points
    Zheng, Chengwei
    Lin, Wenbin
    Xu, Feng
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2024, 46 (08) : 5779 - 5790
  • [10] NeuralEditor: Editing Neural Radiance Fields via Manipulating Point Clouds
    Chen, Jun-Kun
    Lyu, Jipeng
    Wang, Yu-Xiong
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 12439 - 12448