Deep and comprehensive knowledge of the genetic structure of pathogenic species is the cornerstone on which the design of precise molecular diagnostic tools is built. Xanthomonas arboricola is divided into pathovars, some of which are classified as quarantine organisms in many countries and are responsible for diseases on nut and stone fruit trees that have emerged worldwide. Recent taxonomic studies of the genus Xanthomonas showed that strains isolated from other hosts should be classified in X. arboricola, extending the host range of the species. To investigate the genetic structure of X. arboricola and the genetic relationships between highly pathogenic strains and strains apparently not relevant to plant health, we conducted multilocus sequence analyses on a collection of strains representative of the known diversity of the species. Most of the pathovars were clustered in separate monophyletic groups. The pathovars pruni, corylina, and juglandis, responsible for pandemics in specific hosts, were highly phylogenetically related and clustered in three distinct clonal complexes. In contrast, strains with no or uncertain pathogenicity were represented by numerous unrelated singletons scattered in the phylogenic tree. Depending on the pathovar, intra- and interspecies recombination played contrasting roles in generating nucleotide polymorphism. This work provides a population genetics framework for molecular epidemiological surveys of emerging plant pathogens within X. arboricola. Based on our results, we propose to reclassify three former pathovars of Xanthomonas campestris as X. arboricola pv. arracaciae comb. nov., X. arboricola pv. guizotiae comb. nov., and X. arboricola pv. zantedeschiae comb. nov. An emended description of X. arboricola Vauterin et al. 1995 is provided.