Wheat, one of the major crops in the world, has had a complex history that includes genomic hybridizations between Triticum and Aegilops species and several domestication events, which resulted in various wild and domesticated species (especially Triticum aestivum and Triticum durum), many of them still existing today. The large body of information available on wheat-microbe interactions, however, was mostly obtained without considering the importance of wheat evolutionary history and its consequences for wheat microbial ecology. This review addresses our current understanding of the microbiome of wheat root and rhizosphere in light of the information available on pre- and post-domestication wheat history, including differences between wild and domesticated wheats, ancient and modern types of cultivars as well as individual cultivars within a given wheat species. This analysis highlighted two major trends. First, most data deal with the taxonomic diversity rather than the microbial functioning of root-associated wheat microbiota, with so far a bias toward bacteria and mycorrhizal fungi that will progressively attenuate thanks to the inclusion of markers encompassing other micro-eukaryotes and archaea. Second, the comparison of wheat genotypes has mostly focused on the comparison of T. aestivum cultivars, sometimes with little consideration for their particular genetic and physiological traits. It is expected that the development of current sequencing technologies will enable to revisit the diversity of the wheat microbiome. This will provide a renewed opportunity to better understand the significance of wheat evolutionary history, and also to obtain the baseline information needed to develop microbiome-based breeding strategies for sustainable wheat farming.