Computer Vision-based Analysis of Buildings and Built Environments: A Systematic Review of Current Approaches

被引:8
作者
Starzynska-Grzes, Malgorzata B. [1 ]
Roussel, Robin [1 ]
Jacoby, Sam [1 ]
Asadipour, Ali [2 ]
机构
[1] Royal Coll Art, Sch Architecture, Lab Design & Machine Learning, Kensington Gore,South Kensington, London SW7 2EU, England
[2] Royal Coll Art, Comp Sci Res Ctr, Res Ctr, Hester Rd, London SW11 4AN, England
关键词
Architecture; built environment; computer vision; machine learning; image data; GOOGLE STREET VIEW; ARCHITECTURAL DESIGN; URBAN; CLASSIFICATION; IMAGERY; RECONSTRUCTION; EXTRACTION;
D O I
10.1145/3578552
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Analysing 88 sources published from 2011 to 2021, this article presents a first systematic review of the computer vision-based analysis of buildings and the built environment. Its aim is to assess the potential of this research for architectural studies and the implications of a shift to a cross-disciplinarity approach between architecture and computer science for research problems, aims, processes, and applications. To this end, the types of algorithms and data sources used in the reviewed studies are discussed in respect to architectural applications such as a building classification, detail classification, qualitative environmental analysis, building condition survey, and building value estimation. Based on this, current research gaps and trends are identified, with two main research aims emerging. First, studies that use or optimise computer vision methods to automate time-consuming, labour-intensive, or complex tasks when analysing architectural image data. Second, work that explores the methodological benefits of machine learning approaches to overcome limitations of conventional analysis to investigate new questions about the built environment by finding patterns and relationships among visual, statistical, and qualitative data. The growing body of research offers new methods to architectural and design studies, with the article identifying future challenges and directions of research.
引用
收藏
页数:25
相关论文
共 110 条
[41]   IMGTR: Image-triangle based multi-view 3D reconstruction for urban scenes [J].
Hu, Zhihua ;
Hou, Yaolin ;
Tao, Pengjie ;
Shan, Jie .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2021, 181 :191-204
[42]   Urban functional zone mapping by integrating high spatial resolution nighttime light and daytime multi-view imagery [J].
Huang, Xin ;
Yang, Junjing ;
Li, Jiayi ;
Wen, Dawei .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2021, 175 :403-415
[43]   URBAN-i: From urban scenes to mapping slums, transport modes, and pedestrians in cities using deep learning and computer vision [J].
Ibrahim, Mohamed R. ;
Haworth, James ;
Cheng, Tao .
ENVIRONMENT AND PLANNING B-URBAN ANALYTICS AND CITY SCIENCE, 2021, 48 (01) :76-93
[44]   Deep mapping gentrification in a large Canadian city using deep learning and Google Street View [J].
Ilic, Lazar ;
Sawada, M. ;
Zarzelli, Amaury .
PLOS ONE, 2019, 14 (03)
[45]   Life cycle environmental impact assessment to manage and optimize construction waste using Building Information Modeling (BIM) [J].
Jalaei, Farzad ;
Zoghi, Milad ;
Khoshand, Afshin .
INTERNATIONAL JOURNAL OF CONSTRUCTION MANAGEMENT, 2021, 21 (08) :784-801
[46]   Combining satellite imagery and machine learning to predict poverty [J].
Jean, Neal ;
Burke, Marshall ;
Xie, Michael ;
Davis, W. Matthew ;
Lobell, David B. ;
Ermon, Stefano .
SCIENCE, 2016, 353 (6301) :790-794
[47]   Semantic Segmentation of Small Objects and Modeling of Uncertainty in Urban Remote Sensing Images Using Deep Convolutional Neural Networks [J].
Kampffmeyer, Michael ;
Salberg, Arnt-Borre ;
Jenssen, Robert .
PROCEEDINGS OF 29TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, (CVPRW 2016), 2016, :680-688
[48]   Building instance classification using street view images [J].
Kang, Jian ;
Koerner, Marco ;
Wang, Yuanyuan ;
Taubenboeck, Hannes ;
Zhu, Xiao Xiang .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2018, 145 :44-59
[49]   A review of urban physical environment sensing using street view imagery in public health studies [J].
Kang, Yuhao ;
Zhang, Fan ;
Gao, Song ;
Lin, Hui ;
Liu, Yu .
ANNALS OF GIS, 2020, 26 (03) :261-275
[50]   BigSUR: Large-scale Structured Urban Reconstruction [J].
Kelly, Tom ;
Femiani, John ;
Wonka, Peter ;
Mitra, Niloy J. .
ACM TRANSACTIONS ON GRAPHICS, 2017, 36 (06)