Multi-label Building Functions Classification from Ground Pictures using Convolutional Neural Networks

We approach the problem of multi building function classification for buildings from the city of Amsterdam using a collection of Google Street View (GSV) pictures acquired at multiple zoom levels (field of views, FoV) and the corresponding governmental census data per building. Since buildings can have multiple usages, we cast the problem as multi-label classification task. To do so, we trained a CNN model end-to-end with the task of predicting multiple co-occurring building function classes per building. We fuse the individual features of three FoVs by using volumetric stacking. Our proposed model outperforms baseline CNN models that use either single or multiple FoVs.