Deviant Response Patterns and Comparability of Test Scores

Abstract

This study deals with theoretical and methodological problems relating to the comparison of test results of individuals and groups with differing cultural backgrounds. An analysis of the score patterns on test items can be used to identify individuals and groups for whom the test scores have a deviant meaning. A statistic is developed by which the deviance of score patterns can be quantified and which indicates whether or not a person's test score can be compared with the scores in a specific group. In two simulation studies the discriminative power of deviance scores is investigated by means of computer-generated score patterns. The last part of the study deals with the application of deviance scores to cross-cultural research. It is shown that deviance scores can be used to identify individuals for whom the test scores give an underestimation of their capacities.