Stability of the replica-symmetric solution for a perceptron learning from examples
- 1 May 1993
- journal article
- research article
- Published by American Physical Society (APS) in Physical Review E
- Vol. 47 (5), 3707-3711
- https://doi.org/10.1103/physreve.47.3707
Abstract
We study the stability of the replica-symmetric solution for a perceptron learning from examples. By examining the replicon mode, we find the Almeida-Thouless (AT) line signaling a spin-glass phase transition. We find an interesting phase diagram where the AT line crosses the line of zero entropy. Entropy is still negative in a low-temperature region above the AT line. The possibility of a discontinuous phase transition to the replica-symmetry-breaking phase is also discussed.Keywords
This publication has 18 references indexed in Scilit:
- Statistical mechanics of learning from examplesPhysical Review A, 1992
- Learning from examples in large neural networksPhysical Review Letters, 1990
- Inference of a rule by a neural network with thermal noisePhysical Review Letters, 1990
- First-order transition to perfect generalization in a neural network with binary synapsesPhysical Review A, 1990
- The space of interactions in neural network modelsJournal of Physics A: General Physics, 1988
- Layered feed-forward neural network with exactly soluble dynamicsPhysical Review A, 1988
- Maximum Storage Capacity in Neural NetworksEurophysics Letters, 1987
- Exact solution of a layered neural network modelPhysical Review Letters, 1987
- Storing and Retrieving Information in a Layered Spin SystemEurophysics Letters, 1986
- Parallel Distributed ProcessingPublished by MIT Press ,1986