Impact of the Number of Response Categories and Anchor Labels on Coefficient Alpha and Test-Retest Reliability
- 1 December 2004
- journal article
- Published by SAGE Publications in Educational and Psychological Measurement
- Vol. 64 (6), 956-972
- https://doi.org/10.1177/0013164404268674
Abstract
A total of 1,247 college students participated in this study on the effect of scale format on the reliability of Likert-type rating scales. The number of response categories ranged from 3 to 9. Anchor labels on the scales were provided for each response option or for the end points only. The results indicated that the scales with fewresponse categories tended to result in lower reliability, especially lower test-retest reliability. The scales with all the response options clearly labeled were likely to yield higher test-retest reliability than those with only the end points labeled. Scale design that leads to consistent participant responses as indicated by test-retest reliability should be preferred.Keywords
This publication has 33 references indexed in Scilit:
- The Effects of Nonnormality and Number of Response Categories on ReliabilityApplied Measurement in Education, 1996
- What is coefficient alpha? An examination of theory and applications.Journal of Applied Psychology, 1993
- Research Design Effects on the Reliability of Rating Scales: A Meta-AnalysisJournal of Marketing Research, 1984
- Response Differences and Preferences for All-Category-Defined and End-Defined Likert FormatsEducational and Psychological Measurement, 1984
- Number of Response Categories and Statistics on a Teacher Rating ScaleEducational and Psychological Measurement, 1983
- A comparison of the behaviorally anchored rating and mixed standard scale formats.Journal of Applied Psychology, 1980
- Effects of Some Variations in Rating Scale Characteristics on the Means and Reliabilities of RatingsEducational and Psychological Measurement, 1972
- Techniques of attitude scale construction.Published by American Psychological Association (APA) ,1957
- The reliability of self-ratings as a function of the amount of verbal anchoring and of the number of categories on the scale.Journal of Applied Psychology, 1953
- Optimal refinement of the rating scale.Journal of Applied Psychology, 1939