Quantifying and predicting the antigenic characteristics of a virus is something of a holy grail for infectious disease research because of its central importance to the emergence of new strains, the severity of outbreaks, and vaccine selection. However, these characteristics are defined by a complex interplay of viral and host factors so that phylogenetic measures of viral similarity are often poorly correlated to antigenic relationships. Here, we generate antigenic phylogenies that track the phenotypic evolution of two serotypes of foot-and-mouth disease virus by combining host serology and viral sequence data to identify sites that are critical to their antigenic evolution. For serotype SAT1, we validate our antigenic phylogeny against monoclonal antibody escape mutants, which match all of the predicted antigenic sites. For serotype O, we validate it against known sites where available, and otherwise directly evaluate the impact on antigenic phenotype of substitutions in predicted sites using reverse genetics and serology. We also highlight a critical and poorly understood problem for vaccine selection by revealing qualitative differences between assays that are often used interchangeably to determine antigenic match between field viruses and vaccine strains. Our approach provides a tool to identify naturally occurring antigenic substitutions, allowing us to track the genetic diversification and associated antigenic evolution of the virus. Despite the hugely important role vaccines have played in enhancing human and animal health, vaccinology remains a conspicuously empirical science. This study advances the field by providing guidance for tuning vaccine strains via site-directed mutagenesis through this high-resolution tracking of antigenic evolution of the virus between rare major shifts in phenotype.