Subject Matter Experts' Assessment of Item Statistics
- 1 June 1983
- journal article
- Published by SAGE Publications in Applied Psychological Measurement
- Vol. 7 (3), 303-310
- https://doi.org/10.1177/014662168300700306
Abstract
This study was conducted to determine the degree to which subject matter experts could predict the difficulty and discrimination of items on the Test of Standard Written English. It was concluded that despite an extended training period the raters did not approach a high level of accuracy, nor were they able to pinpoint the factors that contribute to item difficulty and discrimination. Further research should attempt to uncover those factors by examining the items from a linguistic and psycholinguistic perspective. It is argued that by coupling linguistic features of the items with subject matter ratings it may be possible to attain more accurate predictions of item difficulty and discriminationKeywords
This publication has 6 references indexed in Scilit:
- CONSTRUCT VALIDITY OF FUNCTIONAL READING TESTSJournal of Educational Measurement, 1980
- Structural variables affecting CaI performance on arithmetic word problems of disadvantaged and deaf studentsEducational Studies in Mathematics, 1974
- TEACHER JUDGMENTS OF TEST ITEM PROPERTIES1Journal of Educational Measurement, 1968
- Some psychological studies of grammar.American Psychologist, 1962
- The Improvement of Estimates of Test DifficultyEducational and Psychological Measurement, 1953
- A Suggested Technique for the Improvement of Difficulty Prediction of Test ItemsEducational and Psychological Measurement, 1952