Learning processes in neural networks
- 1 August 1991
- journal article
- research article
- Published by American Physical Society (APS) in Physical Review A
- Vol. 44 (4), 2718-2726
- https://doi.org/10.1103/physreva.44.2718
Abstract
We study the learning dynamics of neural networks from a general point of view. The environment from which the network learns is defined as a set of input stimuli. At discrete points in time, one of these stimuli is presented and an incremental learning step takes place. If the time between learning steps is drawn from a Poisson distribution, the dynamics of an ensemble of learning processes is described by a continuous-time master equation. A learning algorithm that enables a neural network to adapt to a changing environment must have a nonzero learning parameter. This constant adaptability, however, goes at cost of fluctuations in the plasticities, such as synapses and thresholds. The ensemble description allows us to study the asymptotic behavior of the plasticities for a large class of neural networks. For small learning parameters, we derive an expression for the size of the fluctuations in an unchanging environment. In a changing environment, there is a trade-off between adaptability and accuracy (i.e., size of the fluctuations). We use the networks of Grossberg [J. Stat. Phys. 48, 105 (1969)] and Oja [J. Math. Biol. 15, 267 (1982)] as simple examples to analyze and simulate the performance of neural networks in a changing environment. In some cases an optimal learning parameter can be calculated.Keywords
This publication has 8 references indexed in Scilit:
- A convergence theorem for Grossberg learningNeural Networks, 1990
- Learning representations by back-propagating errorsNature, 1986
- Simplified neuron model as a principal component analyzerJournal of Mathematical Biology, 1982
- Neural networks and physical systems with emergent collective computational abilities.Proceedings of the National Academy of Sciences, 1982
- Self-organized formation of topologically correct feature mapsBiological Cybernetics, 1982
- Stochastic Approximation Methods for Constrained and Unconstrained SystemsPublished by Springer Science and Business Media LLC ,1978
- Analysis of recursive stochastic algorithmsIEEE Transactions on Automatic Control, 1977
- On the Relation between Master Equations and Random Walks and Their SolutionsJournal of Mathematical Physics, 1971