A Revisit to the Behrens–Fisher Problem: Comparison of Five Test Methods
- 19 May 2008
- journal article
- inference
- Published by Taylor & Francis in Communications in Statistics - Simulation and Computation
- Vol. 37 (6), 1064-1085
- https://doi.org/10.1080/03610910802049599
Abstract
We revisit the well-known Behrens–Fisher problem and apply a newly developed ‘Computational Approach Test’ (CAT) to test the equality of two population means where the populations are assumed to be normal with unknown and possibly unequal variances. An advantage of the CAT is that it does not require the explicit knowledge of the sampling distribution of the test statistic. The CAT is then compared with three widely accepted tests—Welch–Satterthwaite test (WST), Cochran–Cox test (CCT), ‘Generalized p-value’ test (GPT)—and a recently suggested test based on the jackknife procedure, called Singh–Saxena–Srivastava test (SSST). Further, model robustness of these five tests are studied when the data actually came from t-distributions, but wrongly perceived as normal ones. Our detailed study based on a comprehensive simulation indicate some interesting results including the facts that the GPT is quite conservative, and the SSST is not as good as it has been claimed in the literature. To the best of our knowledge, the trends observed in our study have not been reported earlier in the existing literature.Keywords
This publication has 15 references indexed in Scilit:
- Fitting Statistical DistributionsPublished by Taylor & Francis ,2000
- Some tests with specified size for the behrens-fisher problemCommunications in Statistics - Theory and Methods, 1999
- PRE‐TEST ESTIMATION AND TESTING IN ECONOMETRICS: RECENT DEVELOPMENTSJournal of Economic Surveys, 1993
- Explaining the Gibbs SamplerThe American Statistician, 1992
- Generalized p-Values in Significance Testing of Hypotheses in the Presence of Nuisance ParametersJournal of the American Statistical Association, 1989
- The Jackknife, the Bootstrap and Other Resampling PlansPublished by Society for Industrial & Applied Mathematics (SIAM) ,1982
- Size and Power of Tests for Equality of Means of Two Normal Populations with Unequal VariancesJournal of the American Statistical Association, 1975
- Probabilities of the Type I Errors of the Welch Tests for the Behrens-Fisher ProblemJournal of the American Statistical Association, 1971
- THE ASYMPTOTIC APPROACH TO BEHRENS'S INTEGRAL, WITH FURTHER TABLES FOR THE d TEST OF SIGNIFICANCEAnnals of Eugenics, 1941
- THE FIDUCIAL ARGUMENT IN STATISTICAL INFERENCEAnnals of Eugenics, 1935