Methodological Considerations in Validating Computer-Based Test Interpretations: Controlling for Response Bias

Although computer-based test interpretation (CBTI) systems have been operational for nearly 25 years, their availability and adoption in routine clinical practice have grown exponentially in recent years. This article addresses methodological considerations in CBTI validation studies, emphasizing those design issues relevant to customer satisfaction studies. Specifically, issues of response bias are addressed as they relate to selection of raters and test respondents, use of random reports as a "control" for spurious ratings of report validity, and both the format and content of ratings. Deficiencies of various studies from the research literature are reviewed, and advantages and limitations of design alternatives are discussed.