On the Evaluation of Training Devices

Abstract

The theme of the paper is ways of evaluating flight simulators for aircrew training. The transfer of training experiment and the rating method are the two present-day ways of evaluating the worth of a simulator. The transfer experiment requires the trainee to practice in the simulator and then be tested in the parent aircraft to demonstrate the training value of the simulator. The rating method requires the pilot to be experienced in the parent aircraft and to rate the simulator for similarity to the aircraft. If similarity is high, the training value is assumed to be high. Arguments are presented that both of these methods are flawed. It is contended that a simulator, or any other system, need not necessarily be tested if it is based on reliable scientific laws and the success of other systems, based on the same laws, has been high. Good laws produce accurate prediction, and when outcome can be predicted it is redundant to conduct a system evaluation. With uncertainty about laws, the requirement for system testing increases. The psychological principles underlying simulators are reviewed.