Learning Automata - A Survey
- 1 July 1974
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Systems, Man, and Cybernetics
- Vol. SMC-4 (4), 323-334
- https://doi.org/10.1109/tsmc.1974.5408453
Abstract
Stochastic automata operating in an unknown random environment have been proposed earlier as models of learning. These automata update their action probabilities in accordance with the inputs received from the environment and can improve their own performance during operation. In this context they are referred to as learning automata. A survey of the available results in the area of learning automata has been attempted in this paper. Attention has been focused on the norms of behavior of learning automata, issues in the design of updating schemes, convergence of the action probabilities, and interaction of several automata. Utilization of learning automata in parameter optimization and hypothesis testing is discussed, and potential areas of application are suggested.Keywords
This publication has 34 references indexed in Scilit:
- An optimal learning algorithm for S-model environmentsIEEE Transactions on Automatic Control, 1973
- An automaton in the nonstationary random environmentInformation Sciences, 1973
- Optimal non-linear reinforcement schemes for stochastic automataInformation Sciences, 1972
- On dimensionality and sample size in statistical pattern classificationPattern Recognition, 1971
- Behaviour of automata in a nonstationary random environmentElectronics Letters, 1971
- The two-armed-bandit problem with time-invariant finite memoryIEEE Transactions on Information Theory, 1970
- On stochastic automata and languagesInformation Sciences, 1969
- Formulation of learning automata and automata gamesInformation Sciences, 1969
- Optimal feedback characteristics from stochastic automaton modelsIEEE Transactions on Automatic Control, 1969
- Learning systems for automatic controlIEEE Transactions on Automatic Control, 1966