Many viruses infecting animals and plants share common cores of homologous genes involved in the key processes of viral replication. In contrast, genes that mediate virus-host interactions including in many cases capsid protein (CP) genes are markedly different. There are three distinct scenarios for the origin of related viruses of plants and animals: first, evolution from a common ancestral virus predating the divergence of plants and animals; second, horizontal transfer of viruses, for example, through insect vectors; third, parallel origin from related genetic elements. We present evidence that each of these scenarios contributed, to a varying extent, to the evolution of different groups of viruses.