Standard Setting in a Small Scale OSCE: A Comparison of the Modified Borderline-Group Method and the Borderline Regression Method
- 1 May 2006
- journal article
- research article
- Published by Springer Science and Business Media LLC in Advances in Health Sciences Education
- Vol. 11 (2), 115-122
- https://doi.org/10.1007/s10459-005-7853-1
Abstract
When setting standards, administrators of small-scale OSCEs often face several challenges, including a lack of resources, a lack of available expertise in statistics, and difficulty in recruiting judges. The Modified Borderline-Group Method is a standard setting procedure that compensates for these challenges by using physician examiners and is easy to use making it a good choice for small scale OSCEs. Unfortunately, the use of this approach may introduce a new challenge. Because a small scale OSCE has a small number of examinees, there may be few examinees in the borderline range, which could introduce an unintentional bias. A standard setting method called The Borderline Regression Method will be described. This standard setting method is similar to the Modified Borderline-Group Method but incorporates a linear regression approach allowing the cut score to be set using the scores from all examinees and not from a subset. The current study uses confidence intervals to analyze the precision of cut scores derived from both approaches when applied to a small scale OSCE.Keywords
This publication has 7 references indexed in Scilit:
- Comparison of a rational and an empirical standard setting procedure for an OSCEMedical Education, 2003
- Standard SettingAcademic Medicine, 2002
- Setting standards for an objective structured clinical examination: the borderline group method gains ground on AngoffMedical Education, 2001
- Standard setting in an objective structured clinical examination: use of global ratings of borderline performance to determine the passing scoreMedical Education, 2001
- Using the Judgments of Physician Examiners in Setting the Standards for a National Multi-center High Stakes OSCEAdvances in Health Sciences Education, 1997
- Standard setting in medical educationAcademic Medicine, 1996
- An Empirical Comparison of Cutoff Score Methods for Content-Related and Criterion-Related Validity SettingsEducational and Psychological Measurement, 1991