Recursive partitioning for heterogeneous causal effects
Top Cited Papers
- 5 July 2016
- journal article
- research article
- Published by Proceedings of the National Academy of Sciences in Proceedings of the National Academy of Sciences of the United States of America
- Vol. 113 (27), 7353-7360
- https://doi.org/10.1073/pnas.1510489113
Abstract
In this paper we propose methods for estimating heterogeneity in causal effects in experimental and observational studies and for conducting hypothesis tests about the magnitude of differences in treatment effects across subsets of the population. We provide a data-driven approach to partition the data into subpopulations that differ in the magnitude of their treatment effects. The approach enables the construction of valid confidence intervals for treatment effects, even with many covariates relative to the sample size, and without “sparsity” assumptions. We propose an “honest” approach to estimation, whereby one sample is used to construct the partition and another to estimate treatment effects for each subpopulation. Our approach builds on regression tree methods, modified to optimize for goodness of fit in treatment effects and to account for honest estimation. Our model selection criterion anticipates that bias will be eliminated by honest estimation and also accounts for the effect of making additional splits on the variance of treatment effect estimates within each subpopulation. We address the challenge that the “ground truth” for a causal effect is not observed for any individual unit, so that standard approaches to cross-validation must be modified. Through a simulation study, we show that for our preferred method honest estimation results in nominal coverage for 90% confidence intervals, whereas coverage ranges between 74% and 84% for nonhonest approaches. Honest estimation requires estimating the model with a smaller sample size; the cost in terms of mean squared error of treatment effects for our preferred method ranges between 7–22%.Keywords
Other Versions
Funding Information
- Microsoft Research (0)
This publication has 25 references indexed in Scilit:
- Modeling Heterogeneous Treatment Effects in Survey Experiments with Bayesian Additive Regression TreesPublic Opinion Quarterly, 2012
- Optimizing randomized trial designs to distinguish which subpopulations benefit from treatmentBiometrika, 2011
- Subgroup Analysis via Recursive PartitioningSSRN Electronic Journal, 2009
- Model-Based Recursive PartitioningJournal of Computational and Graphical Statistics, 2008
- SmcHD1, containing a structural-maintenance-of-chromosomes hinge domain, has a critical role in X inactivationNature Genetics, 2008
- Efficient Estimation of Average Treatment Effects Using the Estimated Propensity ScoreEconometrica, 2003
- Statistics and Causal InferenceJournal of the American Statistical Association, 1986
- Statistics and Causal InferenceJournal of the American Statistical Association, 1986
- The central role of the propensity score in observational studies for causal effectsBiometrika, 1983
- Bayesian Inference for Causal Effects: The Role of RandomizationThe Annals of Statistics, 1978