CONTROL OF ASYMPTOTIC VARIABILITY IN NONHOMOGENEOUS MARKOV SYSTEMS

In this paper we provide two basic results. First, we find the set of all the limiting vectors of expectations, variances and covariances in an NHMS which are possible provided that we control the limit vector of the sequence of vectors of input probabilities. Secondly, under certain conditions easily met in practice we find the distribution of the limiting vector of expectations, variances and covariances to be multinomial with probabilities the corresponding limiting expected populations in the various states of the NHMS.