A Criterion-Referenced Examination of Physician Competence
- 1 March 1988
- journal article
- research article
- Published by SAGE Publications in Evaluation & the Health Professions
- Vol. 11 (1), 98-112
- https://doi.org/10.1177/016327878801100107
Abstract
Despite the growing popularity of performance tests, scores on such measures have rarely been interpreted from a criterionreferenced perspective. This paper describes a test of skill in reading electrocardiographs (ECGs). Using generalizability theory, the errors of measurement and standard setting were estimated both alone and together from a criterionreferenced perspective. Performance on this test was also compared with a measure of the quality of training plus the multiplechoice questions and patient-management problems used in a medical certifying examination. Generalizabilityanalysesproduced positive results for the standard setting procedure and the ECGs, both separately and together. The preliminary validity evidence for scores was encouraging. The criterion-referenced ECGs ranked groups of examinees as expected based on prior education and examination experience. The criterion-referenced ECGs also had modest correlations with traditional measures of physician competence.Keywords
This publication has 7 references indexed in Scilit:
- Reliability, validity and efficiency of multiple choice question and patient management problem item formats in assessment of clinical competenceMedical Education, 1985
- Construct Validity and Criterion-Referenced TestingReview of Educational Research, 1985
- Errors of Measurement and Standard Setting in Mastery TestingApplied Psychological Measurement, 1984
- A Comparison of the Nedelsky and Angoff Cutting Score Procedures Using Generalizability TheoryApplied Psychological Measurement, 1980
- AN INDEX OF DEPENDABILITY FOR MASTERY TESTSJournal of Educational Measurement, 1977
- Instructional technology and the measurement of learing outcomes: Some questions.American Psychologist, 1963
- On the reliability of a weighted compositePsychometrika, 1943