Asymptotic efficiency of estimates for models with incidental nuisance parameters

In this paper we show that the well-known asymptotic efficiency bounds for full mixture models remain valid if individual sequences of nuisance parameters are considered. This is made precise both for some classes of random (i.i.d.) and nonrandom nuisance parameters. For the random case it is shown that superefficiency of the kind given by an example of Pfanzagl can happen only with low probability. The nonrandom case deals with permutation-invariant estimators under one-dimensional nuisance parameters. It is shown that the efficiency bounds remain valid for individual nonrandom arrays of nuisance parameters whose empirical process, if it is centered around its limit and standardized, satisfies a compactness condition. The compactness condition is satisfied in the random case with high probability. The results make use of basic LAN theory. Regularity conditions are stated in terms of L(2)-differentiability.