CHATDESIGN: BOOTSTRAPPING GENERATIVE FLOOR PLAN DESIGN WITH PRE-TRAINED LARGE LANGUAGE MODELS

被引:0
作者
Li, Jinmin [1 ,2 ]
Luo, Yilu [1 ]
Lu, Shuai [1 ]
Zhang, Jingyun [2 ]
Wang, Jun [2 ]
Guo, Rizen [2 ]
Wang, Shaoming [2 ]
机构
[1] Tsinghua Univ, Shenzhen Int Grad Sch, Beijing, Peoples R China
[2] Tencent, Wechat Lab 33, Shenzhen, Peoples R China
来源
PROCEEDINGS OF THE 29TH INTERNATIONAL CONFERENCE OF THE ASSOCIATION FOR COMPUTER-AIDED ARCHITECTURAL DESIGN RESEARCH IN ASIA, CAADRIA 2024, VOL 1 | 2024年
基金
美国国家科学基金会;
关键词
floor plan generation; large language models; user interactions; automatic design; deep learning; pre-train models;
D O I
暂无
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Large language models (LLMs) have achieved remarkable success in various domains, revolutionizing tasks such as language translation, text generation, and question-answering. However, generating floor plan designs poses a unique challenge that demands the fulfilment of intricate spatial and relational constraints. In this paper, we propose ChatDesign, an innovative approach that leverages the power of pre-trained LLMs to generate floor plan designs from natural language descriptions, while incorporating iterative modifications based on user interaction. By processing user input text through a pre-trained LLM and utilizing a decoder, we can generate regression parameters and floor plans that are precisely tailored to satisfy the specific needs of the user. Our approach incorporates an iterative refinement process, optimizing the model output by considering the input text and previous results. Throughout these interactions, we employ many strategic techniques to ensure the generated design images align precisely with the user's requirements. The proposed approach is extensively evaluated through rigorous experiments, including user studies, demonstrating its feasibility and efficacy. The empirical results consistently demonstrate the superiority of our method over existing approaches, showcasing its ability to generate floor plans that rival those created by human designer. Our code will be available at https://github.com/THUKingmin/ChatDesign.
引用
收藏
页码:99 / 108
页数:10
相关论文
共 9 条
[1]   Intelligent Home 3D: Automatic 3D-House Design from Linguistic Descriptions Only [J].
Chen, Qi ;
Wu, Qi ;
Tang, Rui ;
Wang, Yuhan ;
Wang, Shuai ;
Tan, Mingkui .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2020), 2020, :12622-12631
[2]  
Ding Ming, 2021, Advances in Neural Information Processing Systems, V34
[3]  
Leng SC, 2023, Arxiv, DOI arXiv:2311.15941
[4]   Learning to Learn Relation for Important People Detection in Still Images [J].
Li, Wei-Hong ;
Hong, Fa-Ting ;
Zheng, Wei-Shi .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :4998-5006
[5]  
Liu X, 2023, Arxiv, DOI [arXiv:2308.03688, 10.48550/arXiv.2308.03688]
[6]  
Raffel C, 2020, J MACH LEARN RES, V21
[7]  
Saharia C, 2022, ADV NEUR IN
[8]   Data-driven Interior Plan Generation for Residential Buildings [J].
Wu, Wenming ;
Fu, Xiao-Ming ;
Tang, Rui ;
Wang, Yuhan ;
Qi, Yu-Hao ;
Liu, Ligang .
ACM TRANSACTIONS ON GRAPHICS, 2019, 38 (06)
[9]  
Zhang YF, 2024, Arxiv, DOI [arXiv:2308.04371, DOI 10.48550/ARXIV.2308.04371]