Effects of Anchor Item Methods on Differential Item Functioning Detection with the Likelihood Ratio Test
- 1 November 2003
- journal article
- Published by SAGE Publications in Applied Psychological Measurement
- Vol. 27 (6), 479-498
- https://doi.org/10.1177/0146621603259902
Abstract
Through simulations, this study investigates the effects of anchor item methods on Type I error and power of detecting differential item functioning (DIF) using the likelihood ratio test within the framework of item response theory. Four anchor item methods were compared: the all-other, 1-item, 4-item, and 10-item methods. The results showed that it is the average signed area between the reference and focal groups rather than the percentage of DIF items in a test that determines the Type I error of the all-other method. The all-other method yields good control over Type I error and reasonable power only when the average signed area approaches zero. The all-other method is not recommended for practical DIF analysis because it is only adequate under very stringent conditions. The other three methods perform appropriately under all the simulated conditions. The more anchor items are used, the higher the power of DIF detection.Keywords
This publication has 24 references indexed in Scilit:
- Two-Stage Equating in Differential Item Functioning Detection under the Graded Response Model with the Raju Area Measures and the Lord StatisticEducational and Psychological Measurement, 2002
- Evaluating Type I Error and Power Rates Using an Effect Size Measure With the Logistic Regression Procedure for DIF DetectionApplied Measurement in Education, 2001
- An Investigation of the Power of the Likelihood Ratio Goodness‐of‐Fit Statistic in Detecting Differential Item FunctioningJournal of Educational Measurement, 1999
- Detection of Differential Item Functioning Under the Graded Response Model With the Likelihood Ratio TestApplied Psychological Measurement, 1998
- A new procedure for detection of crossing DIFPsychometrika, 1996
- An Investigation of the Likelihood Ratio Test For Detection of Differential Item FunctioningApplied Psychological Measurement, 1996
- A Comparison of Lord's Chi-Square, Raju's Area Measures, and the Likelihood Ratio Test on Detection of Differential Item FunctioningApplied Measurement in Education, 1995
- An Investigation of Lord's Procedure for the Detection of Differential Item FunctioningApplied Psychological Measurement, 1994
- An Iterative Procedure for Linking Metrics and Assessing Item Bias in Item Response TheoryApplied Psychological Measurement, 1988
- Fitting a response model forn dichotomously scored itemsPsychometrika, 1970