Here in this graphic, we show validity as an umbrella, protecting our program’s sources of evidence supporting intended uses from threats or sources of error. Conceptually, validity is an overarching concept under which multiple sources of evidence will be subsumed. This means that tests are neither valid or invalid, but rather how we use the tests that needs to be supported by evidence.
Within the psychometric community, validity is evaluated based on the intended interpretations and uses of scores. Psychometric concepts are often organized around three larger, interrelated concepts: validity, reliability, and fairness. If you work with a psychometrician, it’s important to understand their language.Īs the first in a series on the topic, in this article we will explore terms that psychometricians most commonly use and explain what they mean for non-psychometric audiences.
Although they may fulfill different roles related to design, development, analysis, and evaluation, they are partners in ensuring test results are fair and follow the appropriate standards. Buckendahl, PhDĪ psychometrician is someone involved with psychological measurement. By Kristin Fields, ICE Editor and Chad W.
