HOW TO MAXIMIZE REWARD RATE ON TWO VARIABLE‐INTERVAL PARADIGMS
- 1 May 1981
- journal article
- research article
- Published by Wiley in Journal of the Experimental Analysis of Behavior
- Vol. 35 (3), 367-396
- https://doi.org/10.1901/jeab.1981.35-367
Abstract
Without assuming any constraints on behavior, we derive the policy that maximizes overall reward rate on two variable-interval paradigms. The first paradigm is concurrent variable time-variable time with changeover delay. It is shown that for nearly all parameter values, a switch to the schedule with the longer interval should be followed immediately by a switch back to the schedule with the shorter interval. The matching law does not hold at the optimum and does not uniquely specify the obtained reward rate. The second paradigm is discrete trial concurrent variable interval-variable interval. For given schedule parameters, the optimal policy involves a cycle of a fixed number of choices of the schedule with the shorter interval followed by one choice of the schedule with the longer interval. Molecular maximization sometimes results in optimal behavior.Keywords
This publication has 40 references indexed in Scilit:
- The application of statistical decision theory to animal behaviourJournal of Theoretical Biology, 1980
- Derivatives of matching.Psychological Review, 1979
- Response independence, matching and maximizing: A reply to Heyman.Psychological Review, 1979
- Foraging and reinforcement schedules in the pigeon: Optimal and non-optimal aspects of choiceAnimal Behaviour, 1979
- Reply to Rachlin’s commentLearning & Behavior, 1979
- Comment on Heyman and Luce: “Operant matching is not a logical consequence of maximizing reinforcement rate”Learning & Behavior, 1979
- Operant matching is not a logical consequence of maximizing reinforcement rateLearning & Behavior, 1979
- Sum of responding as a function of sum of reinforcement on two-key concurrent schedulesLearning & Behavior, 1977
- Optimal prey selection in the great tit (Parus major)Animal Behaviour, 1977
- Optimal behavior in free-operant experiments.Psychological Review, 1969