The Use of Propensity Scores for Nonrandomized Designs With Clustered Data
- 31 May 2011
- journal article
- research article
- Published by Informa UK Limited in Multivariate Behavioral Research
- Vol. 46 (3), 514-543
- https://doi.org/10.1080/00273171.2011.569395
Abstract
In this article we propose several modeling choices to extend propensity score analysis to clustered data. We describe different possible model specifications for estimation of the propensity score: single-level model, fixed effects model, and two random effects models. We also consider both conditioning within clusters and conditioning across clusters. We examine the underlying assumptions of these modeling choices and the type of randomized experiment approximated by each approach. Using a simulation study, we compare the relative performance of these modeling and conditioning choices in reducing bias due to confounding variables at both the person and cluster levels. An applied example based on a study by Hughes, Chen, Thoemmes, and Kwok (2010) is provided in which the effect of retention in Grade 1 on passing an achievement test in Grade 3 is evaluated. We find that models that consider the clustered nature of the data both in estimation of the propensity score and conditioning on the propensity score performed best in our simulation study; however, other modeling choices also performed well. The applied example illustrates practical limitations of these models when cluster sizes are small.Keywords
This publication has 27 references indexed in Scilit:
- The specification of the propensity score in multilevel observational studiesComputational Statistics & Data Analysis, 2011
- An Investigation of the Relationship Between Retention in First Grade and Performance on High Stakes Tests in Third GradeEducational Evaluation and Policy Analysis, 2010
- Effects of kindergarten retention on children's social-emotional development: An application of propensity score method to multivariate, multilevel data.Developmental Psychology, 2008
- SOME PRACTICAL GUIDANCE FOR THE IMPLEMENTATION OF PROPENSITY SCORE MATCHINGJournal of Economic Surveys, 2008
- Early-Grade Retention and Children’s Reading and Math Learning in Elementary YearsEducational Evaluation and Policy Analysis, 2007
- Evaluating Kindergarten Retention PolicyJournal of the American Statistical Association, 2006
- Propensity Score Estimation With Boosted Regression for Evaluating Causal Effects in Observational Studies.Psychological Methods, 2004
- Principal Stratification Approach to Broken Randomized ExperimentsJournal of the American Statistical Association, 2003
- Job seeking, reemployment, and mental health: A randomized field experiment in coping with job loss.Journal of Applied Psychology, 1989
- Statistics and Causal InferenceJournal of the American Statistical Association, 1986