On diffusion processes with variable drift rates as models for decision making during learning
Open Access
- 1 January 2008
- journal article
- Published by IOP Publishing in New Journal of Physics
- Vol. 10 (1), 015006 -1-015006 -27
- https://doi.org/10.1088/1367-2630/10/1/015006
Abstract
We investigate Ornstein-Uhlenbeck and diffusion processes with variable drift rates as models of evidence accumulation in a visual discrimination task. We derive power-law and exponential drift-rate models and characterize how parameters of these models affect the psychometric function describing performance accuracy as a function of stimulus strength and viewing time. We fit the models to psychophysical data from monkeys learning the task to identify parameters that best capture performance as it improves with training. The most informative parameter was the overall drift rate describing the signal-to-noise ratio of the sensory evidence used to form the decision, which increased steadily with training. In contrast, secondary parameters describing the time course of the drift during motion viewing did not exhibit steady trends. The results indicate that relatively simple versions of the diffusion model can fit behavior over the course of training, thereby giving a quantitative account of learning effects on the underlying decision process.Keywords
This publication has 35 references indexed in Scilit:
- A Neural Network Model of the Eriksen Task: Reduction, Analysis, and Data FittingNeural Computation, 2008
- Rapid decision threshold modulation by reward rate in a neural networkNeural Networks, 2006
- A Recurrent Network Mechanism of Time Integration in Perceptual DecisionsJournal of Neuroscience, 2006
- Neural basis of deciding, choosing and actingNature Reviews Neuroscience, 2001
- The time course of perceptual choice: The leaky, competing accumulator model.Psychological Review, 2001
- Representation of a perceptual decision in developing oculomotor commandsNature, 2000
- Connectionist and diffusion models of reaction time.Psychological Review, 1999
- Responses of neurons in macaque MT to stochastic motion signalsVisual Neuroscience, 1993
- A theory of order relations in perceptual matching.Psychological Review, 1981
- A theory of memory retrieval.Psychological Review, 1978