We recently discovered a population of very young (tau less than or similar to 6-8 Myr), X-ray emitting black hole binaries (BHBs) in the nearby starburst galaxy NGC 4449. These BHBs are located within or near to very young star clusters, indicating that they form within the clusters, but that some fraction are dynamically ejected. Here we present results from a suite of N-body simulations of N = 16,384 (similar to 6000 M-circle dot) star clusters, similar to the masses of BHB hosts in NGC 4449, through the first 10 Myr of their lives. Our goal is to determine whether dynamical interactions are responsible for the observed population of BHBs in NGC 4449. Our simulations span a wide range of initial size and density profiles, both with and without primordial mass segregation, testing both realistic initial conditions and extreme ones. We find that clusters without primordial mass segregation only dynamically produce BHBs within 10 Myr when they are extremely compact and centrally concentrated. Preliminary results that include primordial binaries support this conclusion. The introduction of strong primordial mass segregation, however, greatly increases the rapidity with which the binaries form, although these are still not tight enough that they will emit X-rays. We conclude that X-ray emitting BHBs are unlikely to form dynamically in clusters of this mass under realistic conditions. Instead, they probably originate from binaries that contain two massive stars with small orbital separations, which are present from the cluster's birth.