Nanodiamonds (NDs) are the potential fillers to provide excellent mechanical and multi-functional capabilities. The growing interest in using NDs in a variety of fields has prompted researchers to use NDs to prepare various structural composites. Proper dispersion and interfacial adhesion between the NDs and the polymer matrix are required to use NDs as effective reinforcement in polymer nanocomposites. In this study, the mechanical properties of the epoxy-based glass fiber (GF)- and carbon fiber (CF)-reinforced laminated composites with the incorporation of annealed nanodiamonds (NDs) in the epoxy matrix was analyzed. The epoxy resin was modified through the step-wise addition of annealed NDs from 0.1 to 0.5 wt.%. The surface-modified NDs were characterized by SEM, XRD, FTIR, and TEM. The test results predict that the tensile strength was increased by 25, 23%, and tensile modulus increases by 33, 135% for GF- and CF-reinforced hybrid composites corresponding to the addition of 0.3 wt.% NDs into the epoxy matrix. Also, the flexural strength increased by 36, 37%, and flexural modulus increased by 71, 37% for the GF- and the CF-reinforced hybrid composites corresponding to the addition of 0.3 wt.% NDs into the epoxy matrix. These improved properties of hybrid composites are mainly due to the enhanced mechanical interlocking and weak Van der Waals force between the NDs particles that caused the efficient dispersion of NDs in the epoxy matrix and it has been reported in this study.