Although the use of measures of model fit is ubiquitous, it is not necessarily obvious that these indexes mean what we want them to mean. Knowing what inferences and uses can be supported for a particular set of numbers is the realm of validity and in this talk I will argue that we have not done nearly enough validation work on our model fit measures.