Metaheuristics for the positioning of 3D objects based on image analysis of complementary 2D photographs

Today, advances in 3D modeling make it possible to identically reproduce objects, animals, humans and even entire scenes. The broad applications concern video games, virtual reality or augmented reality and cinema, for example. In this article, we propose a new method to build a 3D scene directly from several complementary photographs. The positions of the objects for which we already have a 3D model will be determined by triangulation, thanks to the information extracted from the photographs, such as the outline of the objects on the images. Each pixel of the images is converted into a value that gives its distance to the nearest outline. The 3D model of the objects is then projected on the converted images, and the triangulation is done using a cost function that gives the distance of each projection of the objects to their respective outlines. A projection is considered perfect when its distance to its outlines is null, which means that the cost function gives a score of zero as well. We propose to solve this optimization problem by means of two algorithms, namely Simulated Annealing (SA) and quantum particle swarm optimization (QUAPSO).