This paper presents predictions for jet pseudorapidity (eta) and transverse momentum (p(T)) distributions for the production of the standard model Higgs boson in association with a high-p(T) hadronic jet. We discuss the contributions of electroweak loops and of bottom-quark parton processes to the cross section. The latter arise in the five-flavor scheme. Predictions for the Tevatron and the Large Hadron Collider with 10 TeV collision energy are presented. For Higgs boson masses of 120 GeV, 160 GeV, and 200 GeV, we find the maximal effects of the electroweak contributions to the Higgs plus jet p(T) and eta distribution to be -13% and -4.8%, respectively, for the Tevatron, and -2.6% and -1.9%, respectively, for the LHC. For the maximal contribution of bottom-quark parton processes to the p(T) and eta distribution, we find +2.5% and +2%, respectively, for the Tevatron, and +3.3% and +2.8%, respectively, for the LHC. A separate study of the Higgs + b-jet cross section demonstrates that a calculational approach which respects the hierarchies of Yukawa couplings yields a leading-order cross section prediction which is more accurate in the high-T-p regime than conventional approaches.