Self-compacting concrete (SCC) has recently been used in concrete structures due to its improved workability properties compared to conventional concrete; however, the serviceability of SCC structures is usually jeopardized by undesirable impact and dynamic loads due to its brittleness and insufficient toughness. In this study, asphalt emulsion (AE) and fiber were incorporated into SCC to improve its performance properties. SCC samples with basalt fiber (BF), polypropylene fiber (PPF), and polyvinyl alcohol fiber (PVAF) at 0.2%, 0.35%, and 0.5% volume fraction were prepared. Ten percent AE content was used in each mix. The effects of AE and fiber on compressive strength, flexural strength, damping performance, and workability were determined. Results show that incorporating AE and fiber weakens the workability of SCC, and flowability decreases with an increase in fiber content. The compressive strength of SCC decreases when AE is added; however, the incorporation of fiber mitigates this effect. The addition of 10% AE increased the flexural strength by 7.64%, subsequent addition of fiber further increased the flexural strength; the addition of 0.2% BF, PPF, and PVAF increased the flexural strength by 10.14%, 17.94%, and 15.44%, respectively. The damping ratio of SCC increased by 38%, 40%, and 27% through the addition of 0.2% BF, PPF, and PVAF, respectively. However, the damping ratio shows a decreasing trend after adding 0.5% BF and PP fiber.