For two Polish state spaces E-X and E-Y, and an operator G(X), we obtain existence and uniqueness of a G(X-) martingale problem provided there is a bounded continuous duality function E-X x E-Y together with a dual process Y on E-Y which is the unique solution of a G(Y)-martingale problem. For the corresponding solutions (X-t)(t >= 0) and (Y-t)(t >= 0), duality with respect to a function H in its simplest form means that the relation E-x[H (X-t, y)] = E-y[H (x, Y-t)] holds for all (x, y) is an element of E-X x E-Y and t >= 0. While duality is well-known to imply uniqueness of the G(X)-martingale problem, we give here a set of conditions under which duality also implies existence without using approximating sequences of processes of a different kind (e.g. jump processes to approximate diffusions) which is a widespread strategy for proving existence of solutions of martingale problems. Given the process (Yt)(t >= 0) and a duality function H, to prove existence of (X-t)(t >= 0) one has to show that the r.h.s. of the duality relation defines for each y a measure on E-X, i.e. there are transition kernels (mu(t))(t >= 0) from E-X to E-X such that Ey[H(x, Yt)] = integral mu(t)(x, dx') H (x' y) for all (x, y) is an element of E-X x E-Y and all t >= 0. As examples, we treat resampling and branching models, such as the Fleming-Viot measure-valued diffusion and its spatial counterparts (with both, discrete and continuum space), as well as branching systems, such as Feller's branching diffusion. While our main result as well as all examples come with (locally) compact state spaces, we discuss the strategy to lift our results to genealogy-valued processes or historical processes, leading to non-compact (discrete and continuum) state spaces. Such applications will be tackled in forthcoming work based on the present article.