Uniformly most powerful Bayesian tests
Open Access
- 1 August 2013
- journal article
- Published by Institute of Mathematical Statistics in The Annals of Statistics
- Vol. 41 (4), 1716-1741
- https://doi.org/10.1214/13-aos1123
Abstract
Uniformly most powerful tests are statistical hypothesis tests that provide the greatest power against a fixed null hypothesis among all tests of a given size. In this article, the notion of uniformly most powerful tests is extended to the Bayesian setting by defining uniformly most powerful Bayesian tests to be tests that maximize the probability that the Bayes factor, in favor of the alternative hypothesis, exceeds a specified threshold. Like their classical counterpart, uniformly most powerful Bayesian tests are most easily defined in one-parameter exponential family models, although extensions outside of this class are possible. The connection between uniformly most powerful tests and uniformly most powerful Bayesian tests can be used to provide an approximate calibration between $p$-values and Bayes factors. Finally, issues regarding the strong dependence of resulting Bayes factors and $p$-values on sample size are discussed.Keywords
This publication has 13 references indexed in Scilit:
- On the use of Non-Local Prior Densities in Bayesian Hypothesis TestsJournal of the Royal Statistical Society Series B: Statistical Methodology, 2010
- Harold Jeffreys’s Theory of Probability RevisitedStatistical Science, 2009
- Properties of Bayes Factors Based on Test StatisticsScandinavian Journal of Statistics, 2007
- The case for objective Bayesian analysisBayesian Analysis, 2006
- Severe Testing as a Basic Concept in a Neyman–Pearson Philosophy of InductionThe British Journal for the Philosophy of Science, 2006
- Bayes Factors Based on Test StatisticsJournal of the Royal Statistical Society Series B: Statistical Methodology, 2005
- The Intrinsic Bayes Factor for Model Selection and PredictionJournal of the American Statistical Association, 1996
- Testing a Point Null Hypothesis: The Irreconcilability of P Values and EvidenceJournal of the American Statistical Association, 1987
- The Foundations of Statistical Inference.The American Mathematical Monthly, 1963
- A STATISTICAL PARADOXBiometrika, 1957