Comparing Construct Definition in the Angoff and Objective Standard Setting Models
- 22 February 2011
- journal article
- research article
- Published by SAGE Publications in Educational and Psychological Measurement
- Vol. 71 (6), 942-962
- https://doi.org/10.1177/0013164410394338
Abstract
Typical validation studies on standard setting models, most notably the Angoff and modified Angoff models, have ignored construct development, a critical aspect associated with all conceptualizations of measurement processes. Stone compared the Angoff and objective standard setting (OSS) models and found that Angoff failed to define a legitimate and stable construct. The present study replicates and expands this work by presenting results from a 5-year investigation of both models, using two different approaches (equating and annual standard setting) within two testing settings (health care and education). The results support the original conclusion that although the OSS model demonstrates effective construct development, the Angoff approach appears random and lacking in clarity. Implications for creating meaningful and valid standards are discussed.Keywords
This publication has 18 references indexed in Scilit:
- Validity in Psychological Testing and Scientific RealismTheory & Psychology, 2009
- Rasch Analysis of Word Identification and Magnitude Estimation Scaling Responses in Measuring Naïve Listeners' Judgments of Speech Intelligibility of Children With Severe-to-Profound Hearing ImpairmentsJournal of Speech, Language, and Hearing Research, 2008
- Measurement of Speech Disfluency through Magnitude Estimation and Interval ScalingPublished by SAGE Publications ,2006
- The concept of validityPublished by Cambridge University Press (CUP) ,2005
- The Concept of Validity.Psychological Review, 2004
- Comparison of Magnitude Estimation and Interval Scaling of LoudnessPublished by SAGE Publications ,1999
- An Iterative Structured Judgment Process for Establishing Standards on Competency Tests: Theory and ApplicationEducational Evaluation and Policy Analysis, 1982
- Magnitude ScalingPublished by SAGE Publications ,1981
- Test validity and the ethics of assessment.American Psychologist, 1980
- STANDARDS AND CRITERIAJournal of Educational Measurement, 1978