Demonstration of Style2Fab: Functionality-Aware Segmentation for Fabricating Personalized 3D Models with Generative AI

被引:2
|
作者
Faruqi, Faraz [1 ]
Katary, Ahmed [1 ]
Hasic, Tarik [1 ]
Abdel-Rahman, Amira [2 ]
Rahman, Nayeemur [1 ]
Tejedor, Leandra [1 ]
Leake, Mackenzie [1 ]
Hofmann, Megan [3 ]
Mueller, Stefanie [1 ]
机构
[1] MIT, CSAIL, 77 Massachusetts Ave, Cambridge, MA 02139 USA
[2] MIT, Ctr Bits & Atoms, 77 Massachusetts Ave, Cambridge, MA 02139 USA
[3] Northeastern Univ, Khoury Coll Comp Sci, Boston, MA 02115 USA
来源
ADJUNCT PROCEEDINGS OF THE 36TH ANNUAL ACM SYMPOSIUM ON USER INTERFACE SOFTWARE & TECHNOLOGY, UIST 2023 ADJUNCT | 2023年
关键词
personal fabrication; digital fabrication; 3d printing; generative AI;
D O I
10.1145/3586182.3615769
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
With recent advances in Generative AI, it is becoming easier to automatically manipulate 3D models. However, current methods tend to apply edits to models globally, which risks compromising the intended functionality of the 3D model when fabricated in the physical world. For example, modifying functional segments in 3D models, such as the base of a vase, could break the original functionality of the model, thus causing the vase to fall over. We introduce Style2Fab, a system for automatically segmenting 3D models into functional and aesthetic elements, and selectively modifying the aesthetic segments, without affecting the functional segments. Style2Fab uses a semi-automatic classification method to decompose 3D models into functional and aesthetic elements, and differentiable rendering to selectively stylize the functional segments. We demonstrate the functionality of this tool with six application examples across domains of Home Interior Design, Medical Applications, and Personal Accessories.
引用
收藏
页数:5
相关论文
共 2 条
  • [1] VRCopilot: Authoring 3D Layouts with Generative AI Models in VR
    Gettig, Jacob
    Pan, Jin
    Oney, Steve
    Zhang, Lei
    Guo, Anhong
    PROCEEDINGS OF THE 37TH ANNUAL ACM SYMPOSIUM ON USER INTERFACE SOFTWARE AND TECHNOLOGY, USIT 2024, 2024,
  • [2] CoExplorer: Generative AI Powered 2D and 3D Adaptive Interfaces to Support Intentionality in Video Meetings
    Park, Gun Woo
    Panda, Payod
    Tankelevitch, Lev
    Rintel, Sean
    EXTENDED ABSTRACTS OF THE 2024 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS, CHI 2024, 2024,