Program for Computing and Evaluating Reliability Coefficients for Criterion-Referenced Tests

Abstract

Program CRITREL, which is written in BASIC, FORTRAN, and PASCAL, is designed to compute the coefficient of agreement (pO) the kappa coefficient (k), and three linear transformations of these two coefficients, for estimating the reliability of a criterion-referenced test. The program also computes the right-tail hypergeometric and estimated normal curve probabilities of p _o and k. The program is designed primarily for estimating reliability, but it can be used to compute a validity coefficient for a criterion-referenced test when the dependent (predicted or concurrent) variable is dichotomous.