New Procedures to Select the Best Simulated System Using Common Random Numbers
- 1 August 2001
- journal article
- Published by Institute for Operations Research and the Management Sciences (INFORMS) in Management Science
- Vol. 47 (8), 1133-1149
- https://doi.org/10.1287/mnsc.47.8.1133.10229
Abstract
Although simulation is widely used to select the best of several alternative system designs, and common random numbers is an important tool for reducing the computation effort of simulation experiments, there are surprisingly few tools available to help a simulation practitioner select the best system when common random numbers are employed. This paper presents new two-stage procedures that use common random numbers to help identify the best simulated system. The procedures allow for screening and attempt to allocate additional replications to improve the value of information obtained during the second stage, rather than determining the number of replications required to provide a given probability of correct selection guarantee. The procedures allow decision makers to reduce either the expected opportunity cost associated with potentially selecting an inferior system, or the probability of incorrect selection. A small empirical study indicates that the new procedures outperform several procedures with respect to several criteria, and identifies potential areas for further improvement.Multiple Selection, Ranking and Selection, Discrete-Event Simulation, Common Random Numbers, Missing Data, Bayesian StatisticsKeywords
This publication has 18 references indexed in Scilit:
- Multiple comparisons with the best using common random numbers for steady-state simulationsJournal of Statistical Planning and Inference, 2000
- Bayesian look ahead one-stage sampling allocations for selection of the best populationJournal of Statistical Planning and Inference, 1996
- A lower bound for the correct subset-selection probability and its application to discrete-event system simulationsIEEE Transactions on Automatic Control, 1996
- Using Common Random Numbers for Indifference-Zone Selection and Multiple Comparisons in SimulationManagement Science, 1995
- Maximum likelihood estimation for multivariate normal distribution with monotone sampleCommunications in Statistics - Theory and Methods, 1992
- A Bayesian Approach to Ranking and Selection of Related Means with Alternatives to Analysis-of-Variance MethodologyJournal of the American Statistical Association, 1988
- A procedure for selecting a subset of size m containing the l best of k independent normal populations, with applications to simulationCommunications in Statistics - Simulation and Computation, 1985
- Inference about means from incomplete multivariate dataBiometrika, 1976
- Conditional Prediction and Unbiasedness in Structural EquationsEconometrica, 1969
- Maximum Likelihood Estimates for a Multivariate Normal Distribution when Some Observations are MissingJournal of the American Statistical Association, 1957