Two-stream boundary constraints and relativistic generation adversarial network for building contour regularization

Building extraction from high-resolution remote sensing images is still a hot and difficult research topic in the field of remote sensing application and cartography. Although the introduction of deep learning method has greatly improved the accuracy of building segmentation, the problems of irregular contour and unclear boundary in building segmentation mask still exist. In order to obtain regular building contours and clear boundaries, this paper proposes a method of building contour regularization based on two-stream boundary constraint and relativistic generation adversarial network. The network is composed of a two-stream boundary constraint generator and a relativistic average discriminator. The two-stream boundary constraint generator fuses the boundary details of remote sensing images and input labels through the two-stream network architecture and boundary loss function, thus generating regular building contours. The relativistic average discriminator forces the generator to generate a more realistic building mask by evaluating the quality difference between the ground truth label and the generated regularization result. To verify the performance of the model and explore the reasons for the performance improvement, two groups of experiments were designed on WHU building dataset and Inria aerial image labeling dataset, including a comparative experiment and ablation experiment. The experimental results show that this method can generate regularization results that match ground truth labels, and it has obvious advantages in solving the problems of blurred boundaries and irregular contours of segmentation masks. © 2024 SinoMaps Press. All rights reserved.